[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:35 dist-test-slave-8n49 krb5kdc[20811](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:35 dist-test-slave-8n49 krb5kdc[20811](info): set up 2 sockets
Aug 08 14:35:35 dist-test-slave-8n49 krb5kdc[20811](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 14:35:36.510075 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:35:36 dist-test-slave-8n49 krb5kdc[20811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:35:36.637100 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34567
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:42259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:34567
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:36.723390 20826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:36.723642 20826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:36.723680 20826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:36.724848 20826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:36.724929 20826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:36.724958 20826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:36.724990 20826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:36.725013 20826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:36.726701 20826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:34567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:36.727126 20826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:36.727370 20826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:36.735738 20833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:36.735903 20832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:36.735941 20826 server_base.cc:1034] running on GCE node
W20260808 14:35:36.736034 20835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:36.736279 20826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:36.736768 20826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:36.737933 20826 hybrid_clock.cc:648] HybridClock initialized: now 1786199736737918 us; error 28 us; skew 500 ppm
Aug 08 14:35:36 dist-test-slave-8n49 krb5kdc[20811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199736, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:36.740491 20826 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:35:36.741096 20826 webserver.cc:460] Webserver started at http://127.20.81.62:46845/ using document root <none> and password file <none>
I20260808 14:35:36.741398 20826 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:36.741504 20826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:36.741703 20826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:36.742889 20826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "79e299690a3748c3bde9607227dd42a7"
format_stamp: "Formatted at 2026-08-08 14:35:36 on dist-test-slave-8n49"
server_key: "74690251c1370620c866b5a2925a34d0"
server_key_iv: "0a7da31be7e08a0b5b6af36cef087b8c"
server_key_version: "encryptionkey@0"
I20260808 14:35:36.743265 20826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "79e299690a3748c3bde9607227dd42a7"
format_stamp: "Formatted at 2026-08-08 14:35:36 on dist-test-slave-8n49"
server_key: "74690251c1370620c866b5a2925a34d0"
server_key_iv: "0a7da31be7e08a0b5b6af36cef087b8c"
server_key_version: "encryptionkey@0"
I20260808 14:35:36.745157 20826 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260808 14:35:36.746215 20845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:36.746529 20826 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:36.746641 20826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "79e299690a3748c3bde9607227dd42a7"
format_stamp: "Formatted at 2026-08-08 14:35:36 on dist-test-slave-8n49"
server_key: "74690251c1370620c866b5a2925a34d0"
server_key_iv: "0a7da31be7e08a0b5b6af36cef087b8c"
server_key_version: "encryptionkey@0"
I20260808 14:35:36.746712 20826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:36.770874 20826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:36.773519 20826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:36.773672 20826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:36.779361 20826 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:34567
I20260808 14:35:36.779484 20904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:34567 every 8 connection(s)
I20260808 14:35:36.780066 20826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:36.781689 20905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:36.782399 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 20826
I20260808 14:35:36.782534 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:36.783525 20804 external_mini_cluster.cc:1428] Setting key 5e43287beb1d2c0ae24c9f88b8701efa
I20260808 14:35:36.786485 20905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7: Bootstrap starting.
I20260808 14:35:36.787758 20905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:36.788935 20905 log.cc:824] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:36.789997 20905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7: No bootstrap required, opened a new log
I20260808 14:35:36.793927 20905 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e299690a3748c3bde9607227dd42a7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34567 } }
I20260808 14:35:36.794154 20905 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:36.794286 20905 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79e299690a3748c3bde9607227dd42a7, State: Initialized, Role: FOLLOWER
I20260808 14:35:36.794509 20905 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e299690a3748c3bde9607227dd42a7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34567 } }
I20260808 14:35:36.794673 20905 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:36.794723 20905 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:36.794770 20905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:36.795364 20905 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e299690a3748c3bde9607227dd42a7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34567 } }
I20260808 14:35:36.795610 20905 leader_election.cc:302] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79e299690a3748c3bde9607227dd42a7; no voters:
I20260808 14:35:36.795857 20905 leader_election.cc:288] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:36.795894 20910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:36.796125 20910 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [term 1 LEADER]: Becoming Leader. State: Replica: 79e299690a3748c3bde9607227dd42a7, State: Running, Role: LEADER
I20260808 14:35:36.796350 20905 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:36.796360 20910 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e299690a3748c3bde9607227dd42a7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34567 } }
I20260808 14:35:36.797464 20912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79e299690a3748c3bde9607227dd42a7. Latest consensus state: current_term: 1 leader_uuid: "79e299690a3748c3bde9607227dd42a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e299690a3748c3bde9607227dd42a7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34567 } } }
I20260808 14:35:36.797650 20912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:36.797914 20911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79e299690a3748c3bde9607227dd42a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e299690a3748c3bde9607227dd42a7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34567 } } }
I20260808 14:35:36.798026 20911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:36.798771 20923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:36.799896 20923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 14:35:36 dist-test-slave-8n49 krb5kdc[20811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:36.803345 20923 catalog_manager.cc:1347] Generated new cluster ID: 5897979c38024f5d8da6e343a95a954f
I20260808 14:35:36.803408 20923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:35:36.805856 20907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:36.785078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47704 (local address 127.20.81.62:34567)
0808 14:35:36.785517 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:36.785528 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:36.785633 (+ 105us) server_negotiation.cc:407] Connection header received
0808 14:35:36.789274 (+ 3641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:36.789284 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:36.789390 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:36.789508 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:36.791525 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:36.793545 (+ 2020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:36.794815 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:36.795222 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:36.795305 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:36.801248 (+ 5943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:36.801252 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:36.801252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:36.801264 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:36.803188 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:36.803864 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:36.803868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:36.803868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:36.804008 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:36.804339 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:36.804340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:36.804341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:36.804825 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:36.805031 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:36.805365 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 14:35:36.805560 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":109,"threads_started":1}
I20260808 14:35:36.817163 20923 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:36.817934 20923 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:36.824537 20923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79e299690a3748c3bde9607227dd42a7: Generated new TSK 0
I20260808 14:35:36.824761 20923 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:35:36.853953 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34567
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:42259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:36.952095 20933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:36.952332 20933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:36.952374 20933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:36.953617 20933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:36.953683 20933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:36.953730 20933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:35:36.955220 20933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34567
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:36.955572 20933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:36.955819 20933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:36.962080 20939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:36.962075 20938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:36.962235 20941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:36.962484 20933 server_base.cc:1034] running on GCE node
I20260808 14:35:36.962702 20933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:36.962946 20933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:36.964323 20933 hybrid_clock.cc:648] HybridClock initialized: now 1786199736964302 us; error 37 us; skew 500 ppm
Aug 08 14:35:36 dist-test-slave-8n49 krb5kdc[20811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199736, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:36.967343 20933 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:35:36.967844 20933 webserver.cc:460] Webserver started at http://127.20.81.1:46441/ using document root <none> and password file <none>
I20260808 14:35:36.968098 20933 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:36.968142 20933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:36.968286 20933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:36.969406 20933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "d5e066e6812c4fff86b0b6ea22ae5ef9"
format_stamp: "Formatted at 2026-08-08 14:35:36 on dist-test-slave-8n49"
server_key: "e4de8f4e0433ea78663812f74a5c7cda"
server_key_iv: "bb29f2d59595db213692962abc55f8f1"
server_key_version: "encryptionkey@0"
I20260808 14:35:36.969797 20933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "d5e066e6812c4fff86b0b6ea22ae5ef9"
format_stamp: "Formatted at 2026-08-08 14:35:36 on dist-test-slave-8n49"
server_key: "e4de8f4e0433ea78663812f74a5c7cda"
server_key_iv: "bb29f2d59595db213692962abc55f8f1"
server_key_version: "encryptionkey@0"
I20260808 14:35:36.971170 20933 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:35:36.971984 20948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:36.972183 20933 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:36.972285 20933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "d5e066e6812c4fff86b0b6ea22ae5ef9"
format_stamp: "Formatted at 2026-08-08 14:35:36 on dist-test-slave-8n49"
server_key: "e4de8f4e0433ea78663812f74a5c7cda"
server_key_iv: "bb29f2d59595db213692962abc55f8f1"
server_key_version: "encryptionkey@0"
I20260808 14:35:36.972375 20933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:36.981689 20933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:36.983946 20933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:36.984105 20933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:36.984372 20933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:36.984814 20933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:36.984916 20933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:36.984951 20933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:36.984995 20933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:36.991365 20933 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:39359
I20260808 14:35:36.991410 21070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:39359 every 8 connection(s)
I20260808 14:35:36.991751 20933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:35:36 dist-test-slave-8n49 krb5kdc[20811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199736, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:36.999600 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 20933
I20260808 14:35:36.999732 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:36.999908 20804 external_mini_cluster.cc:1428] Setting key cef4a5642e19c0524c1238dd607656f0
I20260808 14:35:37.001909 20907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:36.992686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:39127 (local address 127.20.81.62:34567)
0808 14:35:36.992744 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:36.992746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:36.992925 (+ 179us) server_negotiation.cc:407] Connection header received
0808 14:35:36.993399 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:36.993400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:36.993409 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:36.993467 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:36.994546 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:36.995044 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:36.996144 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:36.996339 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:36.996390 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:36.998711 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:36.998712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:36.998713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:36.998720 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:37.000376 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.000898 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.000899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.000899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.000960 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.001232 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.001233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.001233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.001355 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:37.001446 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:37.001730 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 14:35:37.001817 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:35:37.002115 21073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:36.992637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34567 (local address 127.20.81.1:39127)
0808 14:35:36.992794 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:36.992837 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:36.993315 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:36.993520 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:36.993523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:36.994267 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:36.994466 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:36.994471 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:36.995155 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:36.995156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:36.996063 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:36.996065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:36.996413 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:36.996414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:36.996586 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:36.997185 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:36.997193 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:36.998613 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:37.000493 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:37.000500 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:37.000503 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:37.000816 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:37.001037 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:37.001038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:37.001038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:37.001156 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:37.001441 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:37.001449 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:37.001591 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:35:37.001695 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 14:35:37.001856 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260808 14:35:37.002703 21071 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34567
I20260808 14:35:37.002816 21071 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:37.002996 21071 heartbeater.cc:511] Master 127.20.81.62:34567 requested a full tablet report, sending...
I20260808 14:35:37.003949 20863 ts_manager.cc:194] Registered new tserver with Master: d5e066e6812c4fff86b0b6ea22ae5ef9 (127.20.81.1:39359)
I20260808 14:35:37.005141 20863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:39127
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:35:37.027823 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34567
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:42259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:37.110585 21077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:37.110786 21077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:37.110809 21077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:37.111876 21077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:37.111909 21077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:37.111935 21077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:35:37.113481 21077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34567
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:37.113683 21077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:37.113876 21077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:37.118746 21083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:37.118705 21085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:37.118716 21082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:37.118981 21077 server_base.cc:1034] running on GCE node
I20260808 14:35:37.119202 21077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:37.119470 21077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:37.120626 21077 hybrid_clock.cc:648] HybridClock initialized: now 1786199737120621 us; error 36 us; skew 500 ppm
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[20811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199737, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:37.123220 21077 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:35:37.123625 21077 webserver.cc:460] Webserver started at http://127.20.81.2:38227/ using document root <none> and password file <none>
I20260808 14:35:37.123879 21077 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:37.123929 21077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:37.124074 21077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:37.125209 21077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "7d2f438360534cbc8b0b985071f13ddb"
format_stamp: "Formatted at 2026-08-08 14:35:37 on dist-test-slave-8n49"
server_key: "7065a5defeeb29f8bc01f06410a9a164"
server_key_iv: "2d902fdc3f1b836b9186e4ab7530dc19"
server_key_version: "encryptionkey@0"
I20260808 14:35:37.125592 21077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "7d2f438360534cbc8b0b985071f13ddb"
format_stamp: "Formatted at 2026-08-08 14:35:37 on dist-test-slave-8n49"
server_key: "7065a5defeeb29f8bc01f06410a9a164"
server_key_iv: "2d902fdc3f1b836b9186e4ab7530dc19"
server_key_version: "encryptionkey@0"
I20260808 14:35:37.126955 21077 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:35:37.127698 21094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:37.127878 21077 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:37.127974 21077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "7d2f438360534cbc8b0b985071f13ddb"
format_stamp: "Formatted at 2026-08-08 14:35:37 on dist-test-slave-8n49"
server_key: "7065a5defeeb29f8bc01f06410a9a164"
server_key_iv: "2d902fdc3f1b836b9186e4ab7530dc19"
server_key_version: "encryptionkey@0"
I20260808 14:35:37.128048 21077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:37.142264 21077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:37.144217 21077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:37.144387 21077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:37.144707 21077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:37.145045 21077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:37.145103 21077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:37.145138 21077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:37.145166 21077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:37.151445 21077 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:44061
I20260808 14:35:37.151528 21216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:44061 every 8 connection(s)
I20260808 14:35:37.151877 21077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:35:37.152992 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 21077
I20260808 14:35:37.153096 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:37.153277 20804 external_mini_cluster.cc:1428] Setting key 5a4f8ff4d4c103d2962bda4e3a838b4e
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[20811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199737, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:35:37.162837 20907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:37.152747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:56477 (local address 127.20.81.62:34567)
0808 14:35:37.152829 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:37.152833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:37.153122 (+ 289us) server_negotiation.cc:407] Connection header received
0808 14:35:37.153763 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:37.153765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:37.153776 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:37.153834 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:37.155184 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.155771 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.156904 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.157122 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.157204 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:37.159816 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:37.159817 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:37.159818 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:37.159826 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:37.161377 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.161812 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.161814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.161814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.161876 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.162157 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.162158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.162158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.162284 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:37.162366 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:37.162682 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 14:35:37.162767 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:35:37.162985 21220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:37.152735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34567 (local address 127.20.81.2:56477)
0808 14:35:37.152958 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:37.153012 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:37.153667 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:37.153890 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:37.153893 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:37.154767 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:37.155058 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:37.155065 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.155873 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.155875 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:37.156799 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:37.156801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.157213 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.157214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:37.157352 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:37.158002 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:37.158011 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:37.159711 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:37.161469 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:37.161477 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:37.161480 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:37.161717 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:37.161961 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:37.161962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:37.161963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:37.162085 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:37.162401 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:37.162408 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:37.162532 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 14:35:37.162619 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:35:37.162750 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":113,"threads_started":1}
I20260808 14:35:37.163584 21218 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34567
I20260808 14:35:37.163702 21218 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:37.163856 21218 heartbeater.cc:511] Master 127.20.81.62:34567 requested a full tablet report, sending...
I20260808 14:35:37.164271 20863 ts_manager.cc:194] Registered new tserver with Master: 7d2f438360534cbc8b0b985071f13ddb (127.20.81.2:44061)
I20260808 14:35:37.164884 20863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:56477
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:35:37.181887 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34567
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:42259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:37.264842 21223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:37.265034 21223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:37.265056 21223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:37.266179 21223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:37.266222 21223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:37.266249 21223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:35:37.267715 21223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34567
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:37.267953 21223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:37.268191 21223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:37.273216 21229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:37.273195 21232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:37.273181 21230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:37.273618 21223 server_base.cc:1034] running on GCE node
I20260808 14:35:37.273846 21223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:37.274050 21223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:37.275207 21223 hybrid_clock.cc:648] HybridClock initialized: now 1786199737275176 us; error 31 us; skew 500 ppm
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[20811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199737, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:37.277842 21223 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:35:37.278267 21223 webserver.cc:460] Webserver started at http://127.20.81.3:35223/ using document root <none> and password file <none>
I20260808 14:35:37.278517 21223 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:37.278591 21223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:37.278735 21223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:37.279747 21223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "bfa9dd669d1a4558b034c6a616e2e832"
format_stamp: "Formatted at 2026-08-08 14:35:37 on dist-test-slave-8n49"
server_key: "b58a33ef7d69705d861b4970ab55c3ad"
server_key_iv: "ebe07cdade0d8e327eb1b314a8e8e82b"
server_key_version: "encryptionkey@0"
I20260808 14:35:37.280121 21223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "bfa9dd669d1a4558b034c6a616e2e832"
format_stamp: "Formatted at 2026-08-08 14:35:37 on dist-test-slave-8n49"
server_key: "b58a33ef7d69705d861b4970ab55c3ad"
server_key_iv: "ebe07cdade0d8e327eb1b314a8e8e82b"
server_key_version: "encryptionkey@0"
I20260808 14:35:37.281540 21223 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:35:37.282225 21239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:37.282401 21223 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:37.282507 21223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "bfa9dd669d1a4558b034c6a616e2e832"
format_stamp: "Formatted at 2026-08-08 14:35:37 on dist-test-slave-8n49"
server_key: "b58a33ef7d69705d861b4970ab55c3ad"
server_key_iv: "ebe07cdade0d8e327eb1b314a8e8e82b"
server_key_version: "encryptionkey@0"
I20260808 14:35:37.282581 21223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:37.313742 21223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:37.315701 21223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:37.315862 21223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:37.316110 21223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:37.316416 21223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:37.316471 21223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:37.316515 21223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:37.316540 21223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:37.322705 21223 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:39587
I20260808 14:35:37.322752 21362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:39587 every 8 connection(s)
I20260808 14:35:37.323082 21223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:37.327494 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 21223
I20260808 14:35:37.327586 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:37.327734 20804 external_mini_cluster.cc:1428] Setting key 9fa019c557435a77ac31635a817fe987
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[20811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199737, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:37.333256 20907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:37.323861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:53869 (local address 127.20.81.62:34567)
0808 14:35:37.323922 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:37.323925 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:37.324170 (+ 245us) server_negotiation.cc:407] Connection header received
0808 14:35:37.324896 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:37.324897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:37.324910 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:37.324963 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:37.325995 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.326508 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.327522 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.327813 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.327884 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:37.330397 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:37.330398 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:37.330399 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:37.330405 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:37.331857 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.332267 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.332268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.332268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.332331 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.332635 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.332636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.332636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.332756 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:37.332816 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:37.333122 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 14:35:37.333190 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:35:37.333461 21365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:37.323845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34567 (local address 127.20.81.3:53869)
0808 14:35:37.324062 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:37.324098 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:37.324795 (+ 697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:37.325068 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:37.325072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:37.325715 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:37.325910 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:37.325915 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.326593 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.326595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:37.327425 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:37.327435 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.327958 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.327959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:37.328101 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:37.328759 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:37.328770 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:37.330312 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:37.331946 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:37.331952 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:37.331954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:37.332185 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:37.332412 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:37.332413 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:37.332414 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:37.332535 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:37.332821 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:37.332825 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:37.332970 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 14:35:37.333084 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:35:37.333220 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":97,"threads_started":1}
I20260808 14:35:37.333931 21363 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34567
I20260808 14:35:37.334033 21363 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:37.334223 21363 heartbeater.cc:511] Master 127.20.81.62:34567 requested a full tablet report, sending...
I20260808 14:35:37.334635 20863 ts_manager.cc:194] Registered new tserver with Master: bfa9dd669d1a4558b034c6a616e2e832 (127.20.81.3:39587)
I20260808 14:35:37.335019 20863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:53869
I20260808 14:35:37.340023 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[20811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199737, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[20811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199737, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:35:37.363755 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:37.356076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58078 (local address 127.20.81.1:39359)
0808 14:35:37.356269 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:37.356274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:37.356285 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:35:37.356314 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:37.356316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:37.356330 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:37.356400 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:37.357073 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.357791 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.358524 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.358825 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.358879 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:37.361044 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:37.361052 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:37.361052 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:37.361059 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:37.362658 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.362967 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.362969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.362969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.363037 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.363204 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.363205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.363205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.363327 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:37.363427 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:37.363523 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:35:37.363586 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
W20260808 14:35:37.364262 20978 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58078
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[20811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[20811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:35:37.388237 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:37.381527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58086 (local address 127.20.81.1:39359)
0808 14:35:37.381581 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:37.381582 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:37.381614 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:35:37.381681 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:37.381682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:37.381690 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:37.381736 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:37.382261 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.382745 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.383427 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:37.383629 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:37.383683 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:37.385876 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:37.385878 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:37.385878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:37.385887 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:37.387286 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.387609 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.387610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.387610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.387660 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:37.387830 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:37.387831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:37.387831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:37.387916 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:37.388004 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:37.388077 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:35:37.388138 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:35:37.388864 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 20933
I20260808 14:35:37.396410 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 21077
I20260808 14:35:37.402886 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 21223
I20260808 14:35:37.407768 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 20826
2026-08-08T14:35:37Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1996 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[21377](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[21377](info): set up 2 sockets
Aug 08 14:35:37 dist-test-slave-8n49 krb5kdc[21377](info): commencing operation
krb5kdc: starting...
W20260808 14:35:38.491454 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:35:38 dist-test-slave-8n49 krb5kdc[21377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:35:38.612035 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:46045
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:46045
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:38.694317 21390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:38.694547 21390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:38.694593 21390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:38.695981 21390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:38.696065 21390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:38.696094 21390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:38.696125 21390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:38.696156 21390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:38.697839 21390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:46045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:46045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:38.698125 21390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:38.698354 21390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:38.703184 21398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:38.703182 21395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:38.703258 21390 server_base.cc:1034] running on GCE node
W20260808 14:35:38.703213 21396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:38.703713 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:38.703946 21390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:38.705085 21390 hybrid_clock.cc:648] HybridClock initialized: now 1786199738705076 us; error 34 us; skew 500 ppm
Aug 08 14:35:38 dist-test-slave-8n49 krb5kdc[21377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199738, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:38.707489 21390 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:35:38.707957 21390 webserver.cc:460] Webserver started at http://127.20.81.62:38703/ using document root <none> and password file <none>
I20260808 14:35:38.708177 21390 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:38.708223 21390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:38.708390 21390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:38.709486 21390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "d35f96cbd5f84780a3e582e20b423b4d"
format_stamp: "Formatted at 2026-08-08 14:35:38 on dist-test-slave-8n49"
server_key: "f6eed7ce75347f0759917e9c9ca21108"
server_key_iv: "3f78896a5fcd182a63f6c35b8af0b15f"
server_key_version: "encryptionkey@0"
I20260808 14:35:38.709854 21390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "d35f96cbd5f84780a3e582e20b423b4d"
format_stamp: "Formatted at 2026-08-08 14:35:38 on dist-test-slave-8n49"
server_key: "f6eed7ce75347f0759917e9c9ca21108"
server_key_iv: "3f78896a5fcd182a63f6c35b8af0b15f"
server_key_version: "encryptionkey@0"
I20260808 14:35:38.711148 21390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:35:38.711867 21407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:38.712033 21390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:38.712132 21390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "d35f96cbd5f84780a3e582e20b423b4d"
format_stamp: "Formatted at 2026-08-08 14:35:38 on dist-test-slave-8n49"
server_key: "f6eed7ce75347f0759917e9c9ca21108"
server_key_iv: "3f78896a5fcd182a63f6c35b8af0b15f"
server_key_version: "encryptionkey@0"
I20260808 14:35:38.712212 21390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:38.732473 21390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:38.734325 21390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:38.734483 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:38.738806 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:46045
I20260808 14:35:38.738843 21461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:46045 every 8 connection(s)
I20260808 14:35:38.739216 21390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:38.740073 21462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:38.742435 21462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d: Bootstrap starting.
I20260808 14:35:38.743057 21462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:38.743399 21462 log.cc:824] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:38.744112 21462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d: No bootstrap required, opened a new log
I20260808 14:35:38.745764 21462 raft_consensus.cc:348] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d35f96cbd5f84780a3e582e20b423b4d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46045 } }
I20260808 14:35:38.745921 21462 raft_consensus.cc:374] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:38.745945 21462 raft_consensus.cc:729] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d35f96cbd5f84780a3e582e20b423b4d, State: Initialized, Role: FOLLOWER
I20260808 14:35:38.746114 21462 consensus_queue.cc:260] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d35f96cbd5f84780a3e582e20b423b4d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46045 } }
I20260808 14:35:38.746177 21462 raft_consensus.cc:388] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:38.746234 21462 raft_consensus.cc:482] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:38.746282 21462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:38.746685 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 21390
I20260808 14:35:38.746778 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:38.746999 20804 external_mini_cluster.cc:1428] Setting key dcc4fde45f1e552d73bb54b6b6883b22
I20260808 14:35:38.747068 21462 raft_consensus.cc:504] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d35f96cbd5f84780a3e582e20b423b4d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46045 } }
I20260808 14:35:38.747179 21462 leader_election.cc:302] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d35f96cbd5f84780a3e582e20b423b4d; no voters:
I20260808 14:35:38.747341 21462 leader_election.cc:288] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:38.747363 21465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:38.747480 21465 raft_consensus.cc:686] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [term 1 LEADER]: Becoming Leader. State: Replica: d35f96cbd5f84780a3e582e20b423b4d, State: Running, Role: LEADER
I20260808 14:35:38.747567 21465 consensus_queue.cc:237] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d35f96cbd5f84780a3e582e20b423b4d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46045 } }
I20260808 14:35:38.747604 21462 sys_catalog.cc:564] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:38.747886 21465 sys_catalog.cc:455] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d35f96cbd5f84780a3e582e20b423b4d. Latest consensus state: current_term: 1 leader_uuid: "d35f96cbd5f84780a3e582e20b423b4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d35f96cbd5f84780a3e582e20b423b4d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46045 } } }
I20260808 14:35:38.747960 21465 sys_catalog.cc:458] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:38.748185 21466 sys_catalog.cc:455] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d35f96cbd5f84780a3e582e20b423b4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d35f96cbd5f84780a3e582e20b423b4d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46045 } } }
I20260808 14:35:38.748345 21466 sys_catalog.cc:458] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:38.748266 21472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:38.749001 21472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:38.752636 21472 catalog_manager.cc:1347] Generated new cluster ID: 2575636bdfd44c85bdc2270a84ba76b8
I20260808 14:35:38.752696 21472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:35:38 dist-test-slave-8n49 krb5kdc[21377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:38.760073 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:38.747820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56060 (local address 127.20.81.62:46045)
0808 14:35:38.748015 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:38.748025 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:38.748277 (+ 252us) server_negotiation.cc:407] Connection header received
0808 14:35:38.748403 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:38.748411 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:38.748485 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:38.748648 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:38.749640 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:38.751003 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:38.751855 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:38.752359 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:38.752494 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:38.755408 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:38.755412 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:38.755412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:38.755424 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:38.758357 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:38.758792 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:38.758795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:38.758795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:38.758899 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:38.759112 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:38.759112 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:38.759112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:38.759420 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:38.759568 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:38.759693 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 14:35:38.759823 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":68,"threads_started":1}
I20260808 14:35:38.764868 21472 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:38.765568 21472 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:38.769929 21472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d35f96cbd5f84780a3e582e20b423b4d: Generated new TSK 0
I20260808 14:35:38.770098 21472 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:35:38.800738 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46045
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:38.883747 21490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:38.883978 21490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:38.884019 21490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:38.885315 21490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:38.885380 21490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:38.885425 21490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:35:38.886940 21490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46045
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:38.887217 21490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:38.887452 21490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:35:38.892478 21490 server_base.cc:1034] running on GCE node
W20260808 14:35:38.892421 21499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:38.892417 21495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:38.892423 21496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:38.892940 21490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:38.893220 21490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:38.894367 21490 hybrid_clock.cc:648] HybridClock initialized: now 1786199738894359 us; error 27 us; skew 500 ppm
Aug 08 14:35:38 dist-test-slave-8n49 krb5kdc[21377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199738, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:38.900293 21490 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:35:38.900763 21490 webserver.cc:460] Webserver started at http://127.20.81.1:35167/ using document root <none> and password file <none>
I20260808 14:35:38.900974 21490 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:38.901015 21490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:38.901108 21490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:38.902117 21490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "f54c553a5a2747349eed767f90ddafb5"
format_stamp: "Formatted at 2026-08-08 14:35:38 on dist-test-slave-8n49"
server_key: "7934106f8e15d678643ba6d194a925dd"
server_key_iv: "a1ea60f7907f64fa68ea20d5c32604be"
server_key_version: "encryptionkey@0"
I20260808 14:35:38.902422 21490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "f54c553a5a2747349eed767f90ddafb5"
format_stamp: "Formatted at 2026-08-08 14:35:38 on dist-test-slave-8n49"
server_key: "7934106f8e15d678643ba6d194a925dd"
server_key_iv: "a1ea60f7907f64fa68ea20d5c32604be"
server_key_version: "encryptionkey@0"
I20260808 14:35:38.903743 21490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:35:38.904502 21506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:38.904757 21490 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:38.904862 21490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "f54c553a5a2747349eed767f90ddafb5"
format_stamp: "Formatted at 2026-08-08 14:35:38 on dist-test-slave-8n49"
server_key: "7934106f8e15d678643ba6d194a925dd"
server_key_iv: "a1ea60f7907f64fa68ea20d5c32604be"
server_key_version: "encryptionkey@0"
I20260808 14:35:38.904953 21490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:38.916774 21490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:38.919036 21490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:38.919200 21490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:38.919430 21490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:38.919770 21490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:38.919826 21490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:38.919867 21490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:38.919911 21490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:38.925765 21490 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:41033
I20260808 14:35:38.925808 21624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:41033 every 8 connection(s)
I20260808 14:35:38.926164 21490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:35:38 dist-test-slave-8n49 krb5kdc[21377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199738, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:38.935716 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:38.926977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:49689 (local address 127.20.81.62:46045)
0808 14:35:38.927048 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:38.927050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:38.927249 (+ 199us) server_negotiation.cc:407] Connection header received
0808 14:35:38.928427 (+ 1178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:38.928428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:38.928441 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:38.928500 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:38.929173 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:38.929675 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:38.930732 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:38.930939 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:38.930990 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:38.933176 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:38.933178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:38.933178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:38.933185 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:38.934448 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:38.934836 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:38.934837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:38.934837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:38.934892 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:38.935136 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:38.935138 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:38.935138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:38.935264 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:38.935332 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:38.935571 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 14:35:38.935647 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:35:38.935851 21627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:38.926926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46045 (local address 127.20.81.1:49689)
0808 14:35:38.927110 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:38.927156 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:38.928330 (+ 1174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:38.928609 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:38.928619 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:38.928887 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:38.929095 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:38.929099 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:38.929759 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:38.929760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:38.930654 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:38.930656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:38.931039 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:38.931040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:38.931159 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:38.931633 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:38.931641 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:38.933067 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:38.934529 (+ 1462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:38.934536 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:38.934538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:38.934763 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:38.934955 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:38.934956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:38.934956 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:38.935053 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:38.935331 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:38.935336 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:38.935453 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 14:35:38.935533 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:35:38.935660 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
I20260808 14:35:38.936369 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 21490
I20260808 14:35:38.936483 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:38.936661 21625 heartbeater.cc:347] Connected to a master server at 127.20.81.62:46045
I20260808 14:35:38.936719 20804 external_mini_cluster.cc:1428] Setting key 531e3a45a43ffc524e118cfbbe830ff7
I20260808 14:35:38.936774 21625 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:38.936988 21625 heartbeater.cc:511] Master 127.20.81.62:46045 requested a full tablet report, sending...
I20260808 14:35:38.937513 21424 ts_manager.cc:194] Registered new tserver with Master: f54c553a5a2747349eed767f90ddafb5 (127.20.81.1:41033)
I20260808 14:35:38.938115 21424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:49689
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:35:38.964177 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46045
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:39.061981 21631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:39.062188 21631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:39.062213 21631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:39.063360 21631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:39.063402 21631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:39.063431 21631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:35:39.064985 21631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46045
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:39.065231 21631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:39.065448 21631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:39.070453 21640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:39.070484 21638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:39.070515 21631 server_base.cc:1034] running on GCE node
W20260808 14:35:39.070484 21637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:39.070837 21631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:39.071084 21631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:39.072230 21631 hybrid_clock.cc:648] HybridClock initialized: now 1786199739072222 us; error 29 us; skew 500 ppm
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199739, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:39.074714 21631 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:35:39.075098 21631 webserver.cc:460] Webserver started at http://127.20.81.2:37641/ using document root <none> and password file <none>
I20260808 14:35:39.075294 21631 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:39.075335 21631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:39.075420 21631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:39.076436 21631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f"
format_stamp: "Formatted at 2026-08-08 14:35:39 on dist-test-slave-8n49"
server_key: "d9661694a74ab5e4f88eb652d88b5340"
server_key_iv: "8765a1cf5ad09110515175284ac9b116"
server_key_version: "encryptionkey@0"
I20260808 14:35:39.076848 21631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f"
format_stamp: "Formatted at 2026-08-08 14:35:39 on dist-test-slave-8n49"
server_key: "d9661694a74ab5e4f88eb652d88b5340"
server_key_iv: "8765a1cf5ad09110515175284ac9b116"
server_key_version: "encryptionkey@0"
I20260808 14:35:39.078104 21631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:39.078774 21648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:39.078962 21631 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:39.079061 21631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f"
format_stamp: "Formatted at 2026-08-08 14:35:39 on dist-test-slave-8n49"
server_key: "d9661694a74ab5e4f88eb652d88b5340"
server_key_iv: "8765a1cf5ad09110515175284ac9b116"
server_key_version: "encryptionkey@0"
I20260808 14:35:39.079145 21631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:39.088403 21631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:39.090253 21631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:39.090411 21631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:39.090632 21631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:39.090925 21631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:39.090979 21631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:39.091019 21631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:39.091048 21631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:39.096920 21631 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:41491
I20260808 14:35:39.096990 21766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:41491 every 8 connection(s)
I20260808 14:35:39.097322 21631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:35:39.099381 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 21631
I20260808 14:35:39.099486 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:39.099663 20804 external_mini_cluster.cc:1428] Setting key f34c3cbe8d609fced2a49c78f2a1796a
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199739, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:39.107666 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.098043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:49449 (local address 127.20.81.62:46045)
0808 14:35:39.098109 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.098111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.098302 (+ 191us) server_negotiation.cc:407] Connection header received
0808 14:35:39.099217 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.099219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.099227 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.099281 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:39.100117 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.100719 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.102221 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.102533 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.102618 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.104765 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:39.104767 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:39.104767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:39.104775 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:39.106235 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.106678 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.106680 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.106680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.106742 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.107006 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.107007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.107007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.107129 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:39.107203 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.107485 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.107577 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:35:39.107905 21769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.098015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46045 (local address 127.20.81.2:49449)
0808 14:35:39.098174 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:39.098214 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:39.099114 (+ 900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:39.099358 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:39.099363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:39.099729 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:39.100028 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.100034 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.100803 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.100804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.102121 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.102125 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.102634 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.102635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.102741 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.103228 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:39.103236 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:39.104659 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:39.106339 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:39.106348 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:39.106350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:39.106575 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:39.106816 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:39.106817 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:39.106818 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:39.106936 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:39.107207 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:39.107214 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:39.107350 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 14:35:39.107449 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:35:39.107598 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:35:39.108361 21767 heartbeater.cc:347] Connected to a master server at 127.20.81.62:46045
I20260808 14:35:39.108470 21767 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:39.108693 21767 heartbeater.cc:511] Master 127.20.81.62:46045 requested a full tablet report, sending...
I20260808 14:35:39.109123 21424 ts_manager.cc:194] Registered new tserver with Master: 1e4d81c3f6fc4cf8868b4a7f9b360c4f (127.20.81.2:41491)
I20260808 14:35:39.109503 21424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:49449
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:35:39.127179 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46045
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:39.208001 21773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:39.208245 21773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:39.208282 21773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:39.209489 21773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:39.209559 21773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:39.209609 21773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:35:39.211114 21773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46045
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:39.211374 21773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:39.211598 21773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:39.216611 21780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:39.216676 21779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:39.216745 21773 server_base.cc:1034] running on GCE node
W20260808 14:35:39.216876 21782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:39.217123 21773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:39.217386 21773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:39.218541 21773 hybrid_clock.cc:648] HybridClock initialized: now 1786199739218533 us; error 37 us; skew 500 ppm
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199739, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:39.221076 21773 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:35:39.221504 21773 webserver.cc:460] Webserver started at http://127.20.81.3:46099/ using document root <none> and password file <none>
I20260808 14:35:39.221763 21773 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:39.221835 21773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:39.221987 21773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:39.222995 21773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "4cc8e6a000504a559c8681aa6eb9d018"
format_stamp: "Formatted at 2026-08-08 14:35:39 on dist-test-slave-8n49"
server_key: "b5854fb4b463cbb79fe2b517464ee0ef"
server_key_iv: "8e1574e4617969b56cfb7914eea0c9fc"
server_key_version: "encryptionkey@0"
I20260808 14:35:39.223371 21773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "4cc8e6a000504a559c8681aa6eb9d018"
format_stamp: "Formatted at 2026-08-08 14:35:39 on dist-test-slave-8n49"
server_key: "b5854fb4b463cbb79fe2b517464ee0ef"
server_key_iv: "8e1574e4617969b56cfb7914eea0c9fc"
server_key_version: "encryptionkey@0"
I20260808 14:35:39.224714 21773 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:35:39.225433 21790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:39.225613 21773 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:39.225715 21773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "4cc8e6a000504a559c8681aa6eb9d018"
format_stamp: "Formatted at 2026-08-08 14:35:39 on dist-test-slave-8n49"
server_key: "b5854fb4b463cbb79fe2b517464ee0ef"
server_key_iv: "8e1574e4617969b56cfb7914eea0c9fc"
server_key_version: "encryptionkey@0"
I20260808 14:35:39.225800 21773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:39.241569 21773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:39.243880 21773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:39.244045 21773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:39.244282 21773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:39.244648 21773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:39.244714 21773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:39.244756 21773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:39.244786 21773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:39.251101 21773 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:37423
I20260808 14:35:39.251147 21906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:37423 every 8 connection(s)
I20260808 14:35:39.251466 21773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:39.252075 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 21773
I20260808 14:35:39.252182 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:39.252363 20804 external_mini_cluster.cc:1428] Setting key 9faf659e9e49e19db5c89f3d6c64cac5
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199739, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:39.260744 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.252185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:55301 (local address 127.20.81.62:46045)
0808 14:35:39.252255 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.252257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.252471 (+ 214us) server_negotiation.cc:407] Connection header received
0808 14:35:39.253724 (+ 1253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.253725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.253735 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.253778 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:39.254354 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.254841 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.255794 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.255973 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.256021 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.258032 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:39.258033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:39.258034 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:39.258040 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:39.259448 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.259790 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.259791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.259791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.259840 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.260083 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.260084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.260085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.260204 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:39.260278 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.260575 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.260656 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:35:39.260917 21909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.252146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46045 (local address 127.20.81.3:55301)
0808 14:35:39.252329 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:39.252369 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:39.253620 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:39.253843 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:39.253847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:39.254096 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:39.254283 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.254288 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.254920 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.254921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.255722 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.255724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.256042 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.256043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.256140 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.256629 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:39.256639 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:39.257952 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:39.259517 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:39.259523 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:39.259524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:39.259725 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:39.259897 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:39.259898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:39.259898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:39.260003 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:39.260281 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:39.260287 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:39.260413 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 14:35:39.260511 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:35:39.260690 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":83,"threads_started":1}
I20260808 14:35:39.261402 21907 heartbeater.cc:347] Connected to a master server at 127.20.81.62:46045
I20260808 14:35:39.261482 21907 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:39.261682 21907 heartbeater.cc:511] Master 127.20.81.62:46045 requested a full tablet report, sending...
I20260808 14:35:39.262028 21424 ts_manager.cc:194] Registered new tserver with Master: 4cc8e6a000504a559c8681aa6eb9d018 (127.20.81.3:37423)
I20260808 14:35:39.262405 21424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:55301
I20260808 14:35:39.264209 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:35:39.271727 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.266150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56064 (local address 127.20.81.62:46045)
0808 14:35:39.266213 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.266215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.266295 (+ 80us) server_negotiation.cc:407] Connection header received
0808 14:35:39.266389 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.266389 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.266399 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.266465 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:39.267010 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.267479 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.268183 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.268376 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.268451 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.269530 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:39.269531 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:39.269531 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:39.269538 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:39.270794 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.271104 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.271105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.271105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.271152 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.271316 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.271316 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.271316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.271444 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:39.271517 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.271611 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.271667 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:35:39.274695 21424 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:39.276688 21424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:39.283751 21925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.279818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39170 (local address 127.20.81.1:41033)
0808 14:35:39.280002 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.280006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.280014 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:35:39.280049 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.280051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.280062 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.280151 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:39.280287 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.281204 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.282595 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.283310 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.283384 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.283439 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.283611 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.283653 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":99,"threads_started":1}
I20260808 14:35:39.283887 21920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.279547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:41491 (local address 127.0.0.1:45392)
0808 14:35:39.279709 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:39.279747 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:39.279811 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:39.280362 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:39.280362 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:39.280365 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:39.280394 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.280396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.281695 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.281696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.282837 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.282839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.283598 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.283599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.283654 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.283657 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:39.283689 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 14:35:39.283719 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":45,"threads_started":1}
I20260808 14:35:39.284020 21927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.280044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45392 (local address 127.20.81.2:41491)
0808 14:35:39.280203 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.280208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.280220 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:35:39.280266 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.280268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.280284 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.280369 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:39.280451 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.281589 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.282925 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.283495 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.283775 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.283849 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.283878 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.283925 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
I20260808 14:35:39.283733 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.279557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:41033 (local address 127.0.0.1:39170)
0808 14:35:39.279709 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:39.279747 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:39.279811 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:39.280154 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:39.280157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:39.280159 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:39.280226 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.280228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.281333 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.281334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.282488 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.282491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.283413 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.283414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.283495 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.283511 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:35:39.283585 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:35:39.283649 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
I20260808 14:35:39.284111 21922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.279770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58358 (local address 127.20.81.3:37423)
0808 14:35:39.279950 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.279955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.280303 (+ 348us) server_negotiation.cc:407] Connection header received
0808 14:35:39.280429 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.280432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.280448 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.280498 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:39.280770 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.281852 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.282976 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.283658 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.283725 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.283777 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.283973 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.284015 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":82,"threads_started":1}
I20260808 14:35:39.284340 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.279559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:37423 (local address 127.0.0.1:58358)
0808 14:35:39.280230 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:39.280240 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:39.280334 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:39.280635 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:39.280635 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:39.280637 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:39.280684 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.280685 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.281942 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.281943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.282901 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.282904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.283816 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.283818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.283883 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.283887 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:35:39.284192 (+ 305us) client_negotiation.cc:240] Negotiation successful
0808 14:35:39.284250 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":102,"threads_started":1}
I20260808 14:35:39.284911 21698 tablet_service.cc:1467] Processing CreateTablet for tablet a6cb239dad8e4eb7a9c3256b7e74041a (DEFAULT_TABLE table=test-table [id=a4d2771200c74fd689cc0f6d0977501a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:39.284911 21557 tablet_service.cc:1467] Processing CreateTablet for tablet a6cb239dad8e4eb7a9c3256b7e74041a (DEFAULT_TABLE table=test-table [id=a4d2771200c74fd689cc0f6d0977501a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:39.285262 21557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6cb239dad8e4eb7a9c3256b7e74041a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:39.285277 21698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6cb239dad8e4eb7a9c3256b7e74041a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:39.287874 21928 tablet_bootstrap.cc:492] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5: Bootstrap starting.
I20260808 14:35:39.288540 21928 tablet_bootstrap.cc:654] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:39.289105 21929 tablet_bootstrap.cc:492] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f: Bootstrap starting.
I20260808 14:35:39.289367 21928 log.cc:824] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:39.289386 21839 tablet_service.cc:1467] Processing CreateTablet for tablet a6cb239dad8e4eb7a9c3256b7e74041a (DEFAULT_TABLE table=test-table [id=a4d2771200c74fd689cc0f6d0977501a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:39.289731 21839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6cb239dad8e4eb7a9c3256b7e74041a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:39.289788 21929 tablet_bootstrap.cc:654] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:39.290184 21928 tablet_bootstrap.cc:492] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5: No bootstrap required, opened a new log
I20260808 14:35:39.290263 21928 ts_tablet_manager.cc:1397] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:35:39.290349 21929 log.cc:824] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:39.291147 21929 tablet_bootstrap.cc:492] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f: No bootstrap required, opened a new log
I20260808 14:35:39.291213 21929 ts_tablet_manager.cc:1397] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:39.292315 21928 raft_consensus.cc:348] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } }
I20260808 14:35:39.292522 21928 raft_consensus.cc:374] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:39.292594 21928 raft_consensus.cc:729] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f54c553a5a2747349eed767f90ddafb5, State: Initialized, Role: FOLLOWER
I20260808 14:35:39.292713 21928 consensus_queue.cc:260] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } }
I20260808 14:35:39.292788 21932 tablet_bootstrap.cc:492] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018: Bootstrap starting.
I20260808 14:35:39.292999 21928 ts_tablet_manager.cc:1428] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 14:35:39.293200 21625 heartbeater.cc:503] Master 127.20.81.62:46045 was elected leader, sending a full tablet report...
I20260808 14:35:39.293283 21929 raft_consensus.cc:348] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } }
I20260808 14:35:39.293468 21929 raft_consensus.cc:374] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:39.293511 21932 tablet_bootstrap.cc:654] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:39.293515 21929 raft_consensus.cc:729] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e4d81c3f6fc4cf8868b4a7f9b360c4f, State: Initialized, Role: FOLLOWER
I20260808 14:35:39.293641 21929 consensus_queue.cc:260] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } }
I20260808 14:35:39.293951 21929 ts_tablet_manager.cc:1428] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:35:39.293977 21767 heartbeater.cc:503] Master 127.20.81.62:46045 was elected leader, sending a full tablet report...
I20260808 14:35:39.294140 21932 log.cc:824] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:39.294977 21932 tablet_bootstrap.cc:492] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018: No bootstrap required, opened a new log
I20260808 14:35:39.295075 21932 ts_tablet_manager.cc:1397] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:39.296376 21932 raft_consensus.cc:348] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } }
I20260808 14:35:39.296502 21932 raft_consensus.cc:374] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:39.296525 21932 raft_consensus.cc:729] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cc8e6a000504a559c8681aa6eb9d018, State: Initialized, Role: FOLLOWER
I20260808 14:35:39.296686 21932 consensus_queue.cc:260] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } }
I20260808 14:35:39.296973 21932 ts_tablet_manager.cc:1428] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:39.296981 21907 heartbeater.cc:503] Master 127.20.81.62:46045 was elected leader, sending a full tablet report...
W20260808 14:35:39.347962 21768 tablet.cc:2369] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:35:39.426990 21626 tablet.cc:2369] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:35:39.480620 21936 raft_consensus.cc:482] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:39.480753 21936 raft_consensus.cc:504] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } }
I20260808 14:35:39.481446 21936 leader_election.cc:288] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f54c553a5a2747349eed767f90ddafb5 (127.20.81.1:41033), 1e4d81c3f6fc4cf8868b4a7f9b360c4f (127.20.81.2:41491)
I20260808 14:35:39.484532 21925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.481788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:37257 (local address 127.20.81.1:41033)
0808 14:35:39.481842 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.481844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.481953 (+ 109us) server_negotiation.cc:407] Connection header received
0808 14:35:39.482007 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.482008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.482020 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.482079 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:39.482323 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.482812 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.483813 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.484167 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.484222 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.484230 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.484419 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.484460 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:35:39.484535 21909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.481624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:41491 (local address 127.20.81.3:53111)
0808 14:35:39.481683 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:39.481697 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:39.481747 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:39.482006 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:39.482008 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:39.482010 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:39.482088 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.482091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.482787 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.482788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.483695 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.483697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.484278 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.484280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.484356 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.484359 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:39.484433 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:35:39.484468 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":24}
I20260808 14:35:39.484544 21927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.481785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:53111 (local address 127.20.81.2:41491)
0808 14:35:39.481828 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.481831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.481840 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:39.481875 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.481875 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.481890 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.481948 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:39.482189 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.482716 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.483783 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.484176 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.484268 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.484279 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.484448 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.484487 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:35:39.484541 21937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.481659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:41033 (local address 127.20.81.3:37257)
0808 14:35:39.481876 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:39.481886 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:39.481941 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:39.482113 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:39.482114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:39.482116 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:39.482228 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.482230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.482934 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.482935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.483701 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:39.483703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.484259 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.484260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:39.484331 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.484335 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:35:39.484387 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:35:39.484441 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":2,"thread_start_us":133,"threads_started":1}
I20260808 14:35:39.485051 21719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6cb239dad8e4eb7a9c3256b7e74041a" candidate_uuid: "4cc8e6a000504a559c8681aa6eb9d018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" is_pre_election: true
I20260808 14:35:39.485245 21719 raft_consensus.cc:2454] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cc8e6a000504a559c8681aa6eb9d018 in term 0.
I20260808 14:35:39.485534 21794 leader_election.cc:302] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e4d81c3f6fc4cf8868b4a7f9b360c4f, 4cc8e6a000504a559c8681aa6eb9d018; no voters:
I20260808 14:35:39.485677 21936 raft_consensus.cc:2781] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:39.485736 21936 raft_consensus.cc:482] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:39.485752 21936 raft_consensus.cc:3037] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:39.486420 21936 raft_consensus.cc:504] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } }
I20260808 14:35:39.486527 21936 leader_election.cc:288] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [CANDIDATE]: Term 1 election: Requested vote from peers f54c553a5a2747349eed767f90ddafb5 (127.20.81.1:41033), 1e4d81c3f6fc4cf8868b4a7f9b360c4f (127.20.81.2:41491)
I20260808 14:35:39.486683 21578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6cb239dad8e4eb7a9c3256b7e74041a" candidate_uuid: "4cc8e6a000504a559c8681aa6eb9d018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f54c553a5a2747349eed767f90ddafb5" is_pre_election: true
I20260808 14:35:39.486764 21577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6cb239dad8e4eb7a9c3256b7e74041a" candidate_uuid: "4cc8e6a000504a559c8681aa6eb9d018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f54c553a5a2747349eed767f90ddafb5"
I20260808 14:35:39.486836 21719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6cb239dad8e4eb7a9c3256b7e74041a" candidate_uuid: "4cc8e6a000504a559c8681aa6eb9d018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f"
I20260808 14:35:39.486872 21578 raft_consensus.cc:2454] T a6cb239dad8e4eb7a9c3256b7e74041a P f54c553a5a2747349eed767f90ddafb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cc8e6a000504a559c8681aa6eb9d018 in term 0.
I20260808 14:35:39.486904 21719 raft_consensus.cc:3037] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:39.487634 21719 raft_consensus.cc:2454] T a6cb239dad8e4eb7a9c3256b7e74041a P 1e4d81c3f6fc4cf8868b4a7f9b360c4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cc8e6a000504a559c8681aa6eb9d018 in term 1.
I20260808 14:35:39.487785 21794 leader_election.cc:302] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e4d81c3f6fc4cf8868b4a7f9b360c4f, 4cc8e6a000504a559c8681aa6eb9d018; no voters: f54c553a5a2747349eed767f90ddafb5
I20260808 14:35:39.487983 21936 raft_consensus.cc:2781] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:39.488147 21936 raft_consensus.cc:686] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [term 1 LEADER]: Becoming Leader. State: Replica: 4cc8e6a000504a559c8681aa6eb9d018, State: Running, Role: LEADER
I20260808 14:35:39.488255 21936 consensus_queue.cc:237] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } }
I20260808 14:35:39.489283 21423 catalog_manager.cc:5495] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cc8e6a000504a559c8681aa6eb9d018 (127.20.81.3). New cstate: current_term: 1 leader_uuid: "4cc8e6a000504a559c8681aa6eb9d018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f54c553a5a2747349eed767f90ddafb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 41033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e4d81c3f6fc4cf8868b4a7f9b360c4f" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cc8e6a000504a559c8681aa6eb9d018" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 37423 } health_report { overall_health: HEALTHY } } }
W20260808 14:35:39.502007 21908 tablet.cc:2369] T a6cb239dad8e4eb7a9c3256b7e74041a P 4cc8e6a000504a559c8681aa6eb9d018: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:35:39.513500 21925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.505982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39184 (local address 127.20.81.1:41033)
0808 14:35:39.506068 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.506070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.506190 (+ 120us) server_negotiation.cc:407] Connection header received
0808 14:35:39.506274 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.506275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.506287 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.506355 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:39.506926 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.507431 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.508233 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.508430 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.508506 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.510821 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:39.510836 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:39.510837 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:39.510850 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:39.512224 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.512647 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.512652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.512652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.512721 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.512938 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.512939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.512940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.513087 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:39.513235 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.513311 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.513392 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199739, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199739, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:35:39.539208 21925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.531645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39196 (local address 127.20.81.1:41033)
0808 14:35:39.531716 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.531718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.531759 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:35:39.531842 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.531843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.531852 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.531905 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:39.532520 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.533079 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.533847 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.534028 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.534080 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.536388 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:39.536389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:39.536390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:39.536400 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:39.537964 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.538334 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.538336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.538336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.538396 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.538609 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.538610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.538610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.538712 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:39.538816 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.539014 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.539097 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:35:39.563414 21925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:39.556131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39208 (local address 127.20.81.1:41033)
0808 14:35:39.556222 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:39.556225 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:39.556310 (+ 85us) server_negotiation.cc:407] Connection header received
0808 14:35:39.556416 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:39.556417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:39.556429 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:39.556497 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:39.557129 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.557618 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.558366 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:39.558558 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:39.558633 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:39.560902 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:39.560903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:39.560904 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:39.560912 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:39.562204 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.562602 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.562604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.562604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.562668 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:39.562869 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:39.562870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:39.562870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:39.562978 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:39.563079 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:39.563224 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 14:35:39.563305 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 14:35:39.564239 21534 tablet_service.cc:2908] Rejecting scan request for tablet a6cb239dad8e4eb7a9c3256b7e74041a: Uninitialized: clean time has not yet been initialized
I20260808 14:35:39.565354 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 21490
I20260808 14:35:39.572676 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 21631
I20260808 14:35:39.579380 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 21773
I20260808 14:35:39.584805 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 21390
2026-08-08T14:35:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2177 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21954](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21954](info): set up 2 sockets
Aug 08 14:35:39 dist-test-slave-8n49 krb5kdc[21954](info): commencing operation
krb5kdc: starting...
W20260808 14:35:40.663818 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:35:40 dist-test-slave-8n49 krb5kdc[21954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:35:40.785650 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44745
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:44745
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:40.869431 21967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:40.869642 21967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:40.869666 21967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:40.870847 21967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:40.870893 21967 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:35:40.870908 21967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:40.870920 21967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:40.870932 21967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:40.870971 21967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:40.872509 21967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:44745
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:40.872838 21967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:40.873083 21967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:40.878161 21976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:40.878165 21974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:40.878183 21967 server_base.cc:1034] running on GCE node
W20260808 14:35:40.878165 21973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:40.878680 21967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:40.879009 21967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:40.880149 21967 hybrid_clock.cc:648] HybridClock initialized: now 1786199740880135 us; error 27 us; skew 500 ppm
Aug 08 14:35:40 dist-test-slave-8n49 krb5kdc[21954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199740, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:40.887669 21967 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:35:40.888121 21967 webserver.cc:460] Webserver started at http://127.20.81.62:45043/ using document root <none> and password file <none>
I20260808 14:35:40.888377 21967 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:40.888448 21967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:40.888638 21967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:40.890137 21967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "1910eb3b0a0e47589fb7c4cb43cd1561"
format_stamp: "Formatted at 2026-08-08 14:35:40 on dist-test-slave-8n49"
server_key: "2678cfc7ae9b19fb55b25f3dfe55edf6"
server_key_iv: "0d8111373e63bffd71cda46ee6a919fd"
server_key_version: "encryptionkey@0"
I20260808 14:35:40.890523 21967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "1910eb3b0a0e47589fb7c4cb43cd1561"
format_stamp: "Formatted at 2026-08-08 14:35:40 on dist-test-slave-8n49"
server_key: "2678cfc7ae9b19fb55b25f3dfe55edf6"
server_key_iv: "0d8111373e63bffd71cda46ee6a919fd"
server_key_version: "encryptionkey@0"
I20260808 14:35:40.891922 21967 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:35:40.892817 21983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:40.893018 21967 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:40.893123 21967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "1910eb3b0a0e47589fb7c4cb43cd1561"
format_stamp: "Formatted at 2026-08-08 14:35:40 on dist-test-slave-8n49"
server_key: "2678cfc7ae9b19fb55b25f3dfe55edf6"
server_key_iv: "0d8111373e63bffd71cda46ee6a919fd"
server_key_version: "encryptionkey@0"
I20260808 14:35:40.893201 21967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:40.911434 21967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:40.913342 21967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:40.913504 21967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:40.918398 21967 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:44745
I20260808 14:35:40.918458 22049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:44745 every 8 connection(s)
I20260808 14:35:40.918773 21967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:40.919368 22050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:40.920759 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 21967
I20260808 14:35:40.920862 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:40.921041 20804 external_mini_cluster.cc:1428] Setting key 0c52e5ed84b133d17f987517d47fc7dc
I20260808 14:35:40.922097 22050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561: Bootstrap starting.
I20260808 14:35:40.922645 22050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:40.922936 22050 log.cc:824] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:40.923628 22050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561: No bootstrap required, opened a new log
I20260808 14:35:40.925524 22050 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1910eb3b0a0e47589fb7c4cb43cd1561" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44745 } }
I20260808 14:35:40.925688 22050 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:40.925738 22050 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1910eb3b0a0e47589fb7c4cb43cd1561, State: Initialized, Role: FOLLOWER
I20260808 14:35:40.925863 22050 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1910eb3b0a0e47589fb7c4cb43cd1561" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44745 } }
I20260808 14:35:40.925956 22050 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:40.926017 22050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:40.926097 22050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:40.926599 22050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1910eb3b0a0e47589fb7c4cb43cd1561" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44745 } }
I20260808 14:35:40.926713 22050 leader_election.cc:302] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1910eb3b0a0e47589fb7c4cb43cd1561; no voters:
I20260808 14:35:40.926898 22050 leader_election.cc:288] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:40.926926 22056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:40.927055 22056 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [term 1 LEADER]: Becoming Leader. State: Replica: 1910eb3b0a0e47589fb7c4cb43cd1561, State: Running, Role: LEADER
I20260808 14:35:40.927141 22056 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1910eb3b0a0e47589fb7c4cb43cd1561" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44745 } }
I20260808 14:35:40.927171 22050 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:40.927489 22058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1910eb3b0a0e47589fb7c4cb43cd1561" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1910eb3b0a0e47589fb7c4cb43cd1561" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44745 } } }
I20260808 14:35:40.927587 22058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [sys.catalog]: This master's current role is: LEADER
Aug 08 14:35:40 dist-test-slave-8n49 krb5kdc[21954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:40.927810 22060 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:40.928406 22060 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:40.929018 22057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1910eb3b0a0e47589fb7c4cb43cd1561. Latest consensus state: current_term: 1 leader_uuid: "1910eb3b0a0e47589fb7c4cb43cd1561" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1910eb3b0a0e47589fb7c4cb43cd1561" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44745 } } }
I20260808 14:35:40.929242 22057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:40.930231 22060 catalog_manager.cc:1347] Generated new cluster ID: 2a9b34a5b62c401d950c8d97d090127e
I20260808 14:35:40.930282 22060 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:35:40.932308 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:40.921565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50278 (local address 127.20.81.62:44745)
0808 14:35:40.921747 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:40.921755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:40.921779 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:35:40.922229 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:40.922238 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:40.922302 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:40.922446 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:40.923202 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:40.924205 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:40.925042 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:40.925496 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:40.925631 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:40.928382 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:40.928386 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:40.928387 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:40.928401 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:40.930746 (+ 2345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:40.931147 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:40.931150 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:40.931151 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:40.931246 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:40.931480 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:40.931481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:40.931481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:40.931716 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:40.931857 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:40.931978 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 14:35:40.932115 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
I20260808 14:35:40.947935 22060 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:40.948467 22060 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:40.959967 22060 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561: Generated new TSK 0
I20260808 14:35:40.960187 22060 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:35:40.991667 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44745
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:41.091647 22078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:41.091853 22078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:41.091877 22078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:41.093140 22078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:41.093182 22078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:41.093204 22078 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:35:41.093259 22078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:35:41.094717 22078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.81.62:44745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:41.094970 22078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:41.095208 22078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:35:41.100296 22078 server_base.cc:1034] running on GCE node
W20260808 14:35:41.100279 22087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:41.100279 22085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:41.100270 22084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:41.100765 22078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:41.101014 22078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:41.102160 22078 hybrid_clock.cc:648] HybridClock initialized: now 1786199741102139 us; error 36 us; skew 500 ppm
Aug 08 14:35:41 dist-test-slave-8n49 krb5kdc[21954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:41.104785 22078 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:35:41.105211 22078 webserver.cc:460] Webserver started at http://127.20.81.1:39053/ using document root <none> and password file <none>
I20260808 14:35:41.105455 22078 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:41.105504 22078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:41.105677 22078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:41.106763 22078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "2909c60e98d644fda9e669bf8138759d"
format_stamp: "Formatted at 2026-08-08 14:35:41 on dist-test-slave-8n49"
server_key: "a43d5e43807cf9c809c9a6a415279636"
server_key_iv: "49d917725258d9b4e016a9ee9ad40266"
server_key_version: "encryptionkey@0"
I20260808 14:35:41.107178 22078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "2909c60e98d644fda9e669bf8138759d"
format_stamp: "Formatted at 2026-08-08 14:35:41 on dist-test-slave-8n49"
server_key: "a43d5e43807cf9c809c9a6a415279636"
server_key_iv: "49d917725258d9b4e016a9ee9ad40266"
server_key_version: "encryptionkey@0"
I20260808 14:35:41.108493 22078 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:35:41.109254 22094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.109452 22078 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:35:41.109546 22078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "2909c60e98d644fda9e669bf8138759d"
format_stamp: "Formatted at 2026-08-08 14:35:41 on dist-test-slave-8n49"
server_key: "a43d5e43807cf9c809c9a6a415279636"
server_key_iv: "49d917725258d9b4e016a9ee9ad40266"
server_key_version: "encryptionkey@0"
I20260808 14:35:41.109622 22078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:41.119757 22078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:41.122085 22078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:41.122232 22078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:41.122742 22078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:41.122777 22078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.122799 22078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:41.122849 22078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.130257 22078 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:46533
Aug 08 14:35:41 dist-test-slave-8n49 krb5kdc[21954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:41.130338 22219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:46533 every 8 connection(s)
I20260808 14:35:41.130661 22078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:35:41.133659 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.123411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:58765 (local address 127.20.81.62:44745)
0808 14:35:41.123484 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.123486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.123697 (+ 211us) server_negotiation.cc:407] Connection header received
0808 14:35:41.124301 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.124303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.124316 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.124369 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:41.125315 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.126188 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.127660 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.128024 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.128101 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.130949 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:41.130951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:41.130951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:41.130969 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:41.132504 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.132918 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.132919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.132919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.132980 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.133173 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.133173 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.133174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.133276 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:41.133331 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.133516 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.133593 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:35:41.133809 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.123401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44745 (local address 127.20.81.1:58765)
0808 14:35:41.123576 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.123612 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.124154 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.124462 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.124467 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.124905 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:41.125211 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.125218 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.126285 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.126286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.127549 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.127552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.128118 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.128119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.128287 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.128958 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:41.128968 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:41.130826 (+ 1858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:41.132633 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.132639 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.132641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.132852 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.133032 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.133032 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.133032 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.133120 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.133324 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:41.133327 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:41.133430 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.133502 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.133621 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260808 14:35:41.134385 22220 heartbeater.cc:347] Connected to a master server at 127.20.81.62:44745
I20260808 14:35:41.134532 22220 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:41.134733 22220 heartbeater.cc:511] Master 127.20.81.62:44745 requested a full tablet report, sending...
I20260808 14:35:41.135664 22001 ts_manager.cc:194] Registered new tserver with Master: 2909c60e98d644fda9e669bf8138759d (127.20.81.1:46533)
I20260808 14:35:41.136330 22001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:58765
I20260808 14:35:41.137403 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 22078
I20260808 14:35:41.137506 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:41.137679 20804 external_mini_cluster.cc:1428] Setting key 8e177469aa56d3e223e38c8e3f0dbc1c
I20260808 14:35:41.142601 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.135631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:50381 (local address 127.20.81.62:44745)
0808 14:35:41.136527 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.136529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.136537 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:35:41.136576 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.136577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.136587 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.136650 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:41.136987 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.137659 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.138580 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.138877 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.138955 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.139931 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:41.139932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:41.139932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:41.139938 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:41.141398 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.141814 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.141815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.141815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.141864 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.142076 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.142076 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.142077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.142213 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:41.142273 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.142461 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.142527 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":879}
I20260808 14:35:41.142700 22226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.135569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44745 (local address 127.20.81.1:50381)
0808 14:35:41.135708 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.135736 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.135790 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.136673 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.136674 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.136836 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:41.136896 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.136897 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.137785 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.137786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.138491 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.138494 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.138958 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.138959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.139014 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.139447 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:41.139452 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:41.139844 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:41.141491 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.141492 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.141493 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.141727 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.141934 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.141935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.141935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.142012 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.142292 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:41.142293 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:41.142352 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.142433 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.142559 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:35:41.163292 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44745
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:41.249473 22229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:41.249665 22229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:41.249687 22229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:41.251266 22229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:41.251322 22229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:41.251351 22229 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:35:41.251430 22229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:35:41.253494 22229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.81.62:44745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:41.253736 22229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:41.253981 22229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:41.259732 22234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:41.260061 22235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:41.260341 22229 server_base.cc:1034] running on GCE node
W20260808 14:35:41.260602 22238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:41.260828 22229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:41.261096 22229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:41.262264 22229 hybrid_clock.cc:648] HybridClock initialized: now 1786199741262252 us; error 28 us; skew 500 ppm
Aug 08 14:35:41 dist-test-slave-8n49 krb5kdc[21954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:41.264871 22229 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:35:41.265314 22229 webserver.cc:460] Webserver started at http://127.20.81.2:46443/ using document root <none> and password file <none>
I20260808 14:35:41.265568 22229 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:41.265615 22229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:41.265774 22229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:41.266875 22229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "662892a67a304a42a89412c6bb444119"
format_stamp: "Formatted at 2026-08-08 14:35:41 on dist-test-slave-8n49"
server_key: "f32dbb4d86b299f6f96178052835faf0"
server_key_iv: "38c84b9513674d59b952daeb9c4f11a1"
server_key_version: "encryptionkey@0"
I20260808 14:35:41.267246 22229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "662892a67a304a42a89412c6bb444119"
format_stamp: "Formatted at 2026-08-08 14:35:41 on dist-test-slave-8n49"
server_key: "f32dbb4d86b299f6f96178052835faf0"
server_key_iv: "38c84b9513674d59b952daeb9c4f11a1"
server_key_version: "encryptionkey@0"
I20260808 14:35:41.268677 22229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:35:41.269526 22247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.269750 22229 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:41.269845 22229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "662892a67a304a42a89412c6bb444119"
format_stamp: "Formatted at 2026-08-08 14:35:41 on dist-test-slave-8n49"
server_key: "f32dbb4d86b299f6f96178052835faf0"
server_key_iv: "38c84b9513674d59b952daeb9c4f11a1"
server_key_version: "encryptionkey@0"
I20260808 14:35:41.269938 22229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:41.280790 22229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:41.282820 22229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:41.282968 22229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:41.283497 22229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:41.283536 22229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.283561 22229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:41.283600 22229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:35:41 dist-test-slave-8n49 krb5kdc[21954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:41.291234 22229 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:44859
I20260808 14:35:41.291592 22229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:35:41.291613 22373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:44859 every 8 connection(s)
I20260808 14:35:41.294149 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.284173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:52159 (local address 127.20.81.62:44745)
0808 14:35:41.284235 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.284238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.284448 (+ 210us) server_negotiation.cc:407] Connection header received
0808 14:35:41.285062 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.285063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.285078 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.285129 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:41.285993 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.286856 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.288249 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.288612 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.288698 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.291075 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:41.291077 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:41.291078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:41.291086 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:41.292759 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.293162 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.293164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.293164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.293223 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.293486 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.293487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.293488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.293618 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:41.293692 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.293977 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.294057 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:35:41.294340 22256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.284136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44745 (local address 127.20.81.2:52159)
0808 14:35:41.284323 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.284359 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.284940 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.285208 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.285212 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.285586 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:41.285873 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.285878 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.286960 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.286961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.288146 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.288150 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.288720 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.288721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.288885 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.289450 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:41.289460 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:41.290992 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:41.292846 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.292853 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.292855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.293078 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.293299 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.293300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.293301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.293415 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.293694 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:41.293701 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:41.293839 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.293940 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.294107 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":101,"threads_started":1}
I20260808 14:35:41.294978 22375 heartbeater.cc:347] Connected to a master server at 127.20.81.62:44745
I20260808 14:35:41.295090 22375 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:41.295307 22375 heartbeater.cc:511] Master 127.20.81.62:44745 requested a full tablet report, sending...
I20260808 14:35:41.295714 21999 ts_manager.cc:194] Registered new tserver with Master: 662892a67a304a42a89412c6bb444119 (127.20.81.2:44859)
I20260808 14:35:41.296164 21999 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:52159
I20260808 14:35:41.300522 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 22229
I20260808 14:35:41.300683 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:41.300860 20804 external_mini_cluster.cc:1428] Setting key d9079167ac98b3dcd34b522f021fd0da
I20260808 14:35:41.301573 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.296039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:52165 (local address 127.20.81.62:44745)
0808 14:35:41.296083 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.296086 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.296218 (+ 132us) server_negotiation.cc:407] Connection header received
0808 14:35:41.296312 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.296312 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.296322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.296371 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:41.296755 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.297252 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.297937 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.298147 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.298223 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.299025 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:41.299026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:41.299026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:41.299033 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:41.300083 (+ 1050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.300523 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.300524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.300525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.300660 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.300932 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.300933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.300933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.301103 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:41.301196 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.301370 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.301473 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:35:41.301609 22381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.295978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44745 (local address 127.20.81.2:52165)
0808 14:35:41.296152 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.296161 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.296231 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.296374 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.296374 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.296611 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:41.296672 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.296674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.297346 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.297347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.297847 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.297848 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.298222 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.298223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.298301 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.298670 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:41.298675 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:41.298936 (+ 261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:41.300182 (+ 1246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.300183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.300184 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.300392 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.300760 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.300762 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.300762 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.300839 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.301186 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:41.301187 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:41.301241 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.301340 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.301498 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:35:41.328783 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44745
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:41.414646 22384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:41.414870 22384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:41.414908 22384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:41.416036 22384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:41.416101 22384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:41.416136 22384 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:35:41.416177 22384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:35:41.417657 22384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.81.62:44745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:41.417932 22384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:41.418159 22384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:41.423211 22390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:41.423218 22389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:41.423249 22384 server_base.cc:1034] running on GCE node
W20260808 14:35:41.423244 22392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:41.423655 22384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:41.423928 22384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:41.425117 22384 hybrid_clock.cc:648] HybridClock initialized: now 1786199741425102 us; error 42 us; skew 500 ppm
Aug 08 14:35:41 dist-test-slave-8n49 krb5kdc[21954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:41.428160 22384 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:35:41.428875 22384 webserver.cc:460] Webserver started at http://127.20.81.3:40621/ using document root <none> and password file <none>
I20260808 14:35:41.429236 22384 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:41.429296 22384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:41.429394 22384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:41.430403 22384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "3ae5c2bae88249c2a6dc264c57cd1b41"
format_stamp: "Formatted at 2026-08-08 14:35:41 on dist-test-slave-8n49"
server_key: "542ee82ae148b775c7869ab656c9e860"
server_key_iv: "b3072b3e3b7f91d3769ed323c7087c6a"
server_key_version: "encryptionkey@0"
I20260808 14:35:41.430712 22384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "3ae5c2bae88249c2a6dc264c57cd1b41"
format_stamp: "Formatted at 2026-08-08 14:35:41 on dist-test-slave-8n49"
server_key: "542ee82ae148b775c7869ab656c9e860"
server_key_iv: "b3072b3e3b7f91d3769ed323c7087c6a"
server_key_version: "encryptionkey@0"
I20260808 14:35:41.432071 22384 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:35:41.433024 22400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.433225 22384 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:35:41.433318 22384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "3ae5c2bae88249c2a6dc264c57cd1b41"
format_stamp: "Formatted at 2026-08-08 14:35:41 on dist-test-slave-8n49"
server_key: "542ee82ae148b775c7869ab656c9e860"
server_key_iv: "b3072b3e3b7f91d3769ed323c7087c6a"
server_key_version: "encryptionkey@0"
I20260808 14:35:41.433377 22384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:41.449079 22384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:41.451143 22384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:41.451263 22384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:41.451759 22384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:41.451797 22384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.451820 22384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:41.451833 22384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.458992 22384 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:39625
I20260808 14:35:41.459131 22528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:39625 every 8 connection(s)
Aug 08 14:35:41 dist-test-slave-8n49 krb5kdc[21954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:41.459451 22384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:41.462710 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.452347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:36023 (local address 127.20.81.62:44745)
0808 14:35:41.452460 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.452463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.452689 (+ 226us) server_negotiation.cc:407] Connection header received
0808 14:35:41.453312 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.453313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.453327 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.453376 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:41.454276 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.455165 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.456778 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.457095 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.457185 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.459926 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:41.459935 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:41.459935 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:41.459943 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:41.461521 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.461920 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.461921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.461922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.461975 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.462210 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.462211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.462211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.462317 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:41.462364 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.462584 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.462646 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 14:35:41.462940 22411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.452289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44745 (local address 127.20.81.3:36023)
0808 14:35:41.452508 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.452591 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.453187 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.453471 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.453476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.453859 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:41.454156 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.454163 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.455281 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.455281 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.456676 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.456680 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.457189 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.457190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.457302 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.457908 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:41.457920 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:41.459826 (+ 1906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:41.461621 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.461627 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.461629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.461849 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.462039 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.462040 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.462040 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.462134 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.462361 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:41.462364 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:41.462483 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.462562 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.462681 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":104,"threads_started":1}
I20260808 14:35:41.463477 22529 heartbeater.cc:347] Connected to a master server at 127.20.81.62:44745
I20260808 14:35:41.463577 22529 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:41.463785 22529 heartbeater.cc:511] Master 127.20.81.62:44745 requested a full tablet report, sending...
I20260808 14:35:41.464184 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 22384
I20260808 14:35:41.464205 22001 ts_manager.cc:194] Registered new tserver with Master: 3ae5c2bae88249c2a6dc264c57cd1b41 (127.20.81.3:39625)
I20260808 14:35:41.464274 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:41.464497 20804 external_mini_cluster.cc:1428] Setting key 7e04c200cb629d5fedacb09c7ce3c24a
I20260808 14:35:41.464756 22001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:36023
I20260808 14:35:41.465999 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:35:41.471452 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.464820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:35389 (local address 127.20.81.62:44745)
0808 14:35:41.464868 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.464870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.464939 (+ 69us) server_negotiation.cc:407] Connection header received
0808 14:35:41.465059 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.465060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.465071 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.465129 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:41.465927 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.466510 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.467301 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.467531 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.467615 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.468737 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:41.468738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:41.468739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:41.468747 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:41.470177 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.470566 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.470567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.470568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.470630 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.470865 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.470866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.470866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.471002 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:41.471088 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.471269 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.471347 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:35:41.471472 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.464613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44745 (local address 127.20.81.3:35389)
0808 14:35:41.464878 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.464890 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.464967 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.465622 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.465623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.465782 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:41.465830 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.465831 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.466620 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.466622 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.467193 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.467194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.467614 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.467615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.467699 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.468238 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:41.468243 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:41.468615 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:41.470275 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.470276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.470277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.470481 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.470715 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:41.470716 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:41.470716 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:41.470785 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:41.471079 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:41.471080 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:41.471130 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.471222 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.471345 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":74,"threads_started":1}
Aug 08 14:35:41 dist-test-slave-8n49 krb5kdc[21954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199741, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:35:41 dist-test-slave-8n49 krb5kdc[21954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199741, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:41.491003 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.484024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50292 (local address 127.20.81.62:44745)
0808 14:35:41.484098 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.484100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.484109 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:41.484174 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.484175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.484184 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.484236 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:41.484903 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.485407 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.486157 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.486358 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.486424 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.488683 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:41.488685 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:41.488686 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:41.488694 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:41.489931 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.490293 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.490294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.490294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.490355 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:41.490534 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:41.490534 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:41.490535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:41.490653 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:41.490735 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.490821 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.490887 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:35:41.492689 22001 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:41.494309 22001 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:41.501439 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.497168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55132 (local address 127.20.81.3:39625)
0808 14:35:41.497498 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.497501 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.497817 (+ 316us) server_negotiation.cc:407] Connection header received
0808 14:35:41.497868 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.497870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.497885 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.497964 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:41.498099 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.498801 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.500238 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.500999 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.501080 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.501140 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.501293 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.501338 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":90,"threads_started":1}
I20260808 14:35:41.501441 22547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.497006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39625 (local address 127.0.0.1:55132)
0808 14:35:41.497712 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.497721 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.497761 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.497974 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.497975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.497976 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:41.498012 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.498013 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.498912 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.498913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.500130 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.500133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.501096 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.501098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.501177 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.501192 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.501268 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.501330 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":123,"threads_started":1}
I20260808 14:35:41.501441 22549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.496906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:46533 (local address 127.0.0.1:39308)
0808 14:35:41.497320 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.497370 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.497478 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.497831 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.497836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.497838 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:41.497910 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.497912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.499256 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.499257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.500168 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.500171 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.501178 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.501179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.501261 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.501266 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.501320 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.501357 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":24,"thread_start_us":71,"threads_started":1}
I20260808 14:35:41.501632 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.497116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39308 (local address 127.20.81.1:46533)
0808 14:35:41.497287 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.497293 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.497459 (+ 166us) server_negotiation.cc:407] Connection header received
0808 14:35:41.497644 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.497647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.497665 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.497746 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:41.497992 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.499161 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.500279 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.500999 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.501080 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.501140 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.501483 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.501527 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
I20260808 14:35:41.502168 22458 tablet_service.cc:1467] Processing CreateTablet for tablet 2affad08adb548d5815c6c3c4ca27ce7 (DEFAULT_TABLE table=test-table [id=fa17a8c546b044bca713b3c2f1a395df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:41.502308 22150 tablet_service.cc:1467] Processing CreateTablet for tablet 2affad08adb548d5815c6c3c4ca27ce7 (DEFAULT_TABLE table=test-table [id=fa17a8c546b044bca713b3c2f1a395df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:41.502472 22458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2affad08adb548d5815c6c3c4ca27ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:41.502578 22150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2affad08adb548d5815c6c3c4ca27ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:41.504856 22553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.497184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54908 (local address 127.20.81.2:44859)
0808 14:35:41.497404 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.497408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.497628 (+ 220us) server_negotiation.cc:407] Connection header received
0808 14:35:41.497702 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.497705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.497721 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.497797 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:41.498055 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.499148 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.500516 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.501081 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.501153 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.501211 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.501398 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.501436 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":85,"threads_started":1}
I20260808 14:35:41.505134 22550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.496912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:44859 (local address 127.0.0.1:54908)
0808 14:35:41.497559 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.497569 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.497629 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.497873 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.497874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.497875 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:41.497930 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.497951 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.499239 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.499240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.500429 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.500432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.501245 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.501246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.501302 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.501305 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.505007 (+ 3702us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.505060 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"mutex_wait_us":46,"thread_start_us":76,"threads_started":1}
I20260808 14:35:41.505524 22556 tablet_bootstrap.cc:492] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: Bootstrap starting.
I20260808 14:35:41.505599 22555 tablet_bootstrap.cc:492] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: Bootstrap starting.
I20260808 14:35:41.505817 22301 tablet_service.cc:1467] Processing CreateTablet for tablet 2affad08adb548d5815c6c3c4ca27ce7 (DEFAULT_TABLE table=test-table [id=fa17a8c546b044bca713b3c2f1a395df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:41.506168 22301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2affad08adb548d5815c6c3c4ca27ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:41.506287 22556 tablet_bootstrap.cc:654] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:41.506502 22555 tablet_bootstrap.cc:654] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:41.506659 22556 log.cc:824] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:41.506848 22555 log.cc:824] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:41.507504 22556 tablet_bootstrap.cc:492] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: No bootstrap required, opened a new log
I20260808 14:35:41.507593 22556 ts_tablet_manager.cc:1397] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:35:41.507616 22555 tablet_bootstrap.cc:492] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: No bootstrap required, opened a new log
I20260808 14:35:41.507689 22555 ts_tablet_manager.cc:1397] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:41.509197 22556 raft_consensus.cc:348] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } }
I20260808 14:35:41.509351 22556 raft_consensus.cc:374] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:41.509395 22556 raft_consensus.cc:729] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2909c60e98d644fda9e669bf8138759d, State: Initialized, Role: FOLLOWER
I20260808 14:35:41.509502 22556 consensus_queue.cc:260] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } }
I20260808 14:35:41.509802 22556 ts_tablet_manager.cc:1428] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:41.509838 22220 heartbeater.cc:503] Master 127.20.81.62:44745 was elected leader, sending a full tablet report...
I20260808 14:35:41.510061 22560 tablet_bootstrap.cc:492] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: Bootstrap starting.
I20260808 14:35:41.510283 22555 raft_consensus.cc:348] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } }
I20260808 14:35:41.510442 22555 raft_consensus.cc:374] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:41.510478 22555 raft_consensus.cc:729] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae5c2bae88249c2a6dc264c57cd1b41, State: Initialized, Role: FOLLOWER
I20260808 14:35:41.510581 22555 consensus_queue.cc:260] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } }
I20260808 14:35:41.510742 22560 tablet_bootstrap.cc:654] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:41.510869 22555 ts_tablet_manager.cc:1428] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:35:41.511085 22529 heartbeater.cc:503] Master 127.20.81.62:44745 was elected leader, sending a full tablet report...
I20260808 14:35:41.511109 22560 log.cc:824] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:41.511883 22560 tablet_bootstrap.cc:492] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: No bootstrap required, opened a new log
I20260808 14:35:41.511961 22560 ts_tablet_manager.cc:1397] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:35:41.513422 22560 raft_consensus.cc:348] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } }
I20260808 14:35:41.513563 22560 raft_consensus.cc:374] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:41.513612 22560 raft_consensus.cc:729] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 662892a67a304a42a89412c6bb444119, State: Initialized, Role: FOLLOWER
I20260808 14:35:41.513720 22560 consensus_queue.cc:260] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } }
I20260808 14:35:41.513968 22560 ts_tablet_manager.cc:1428] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:41.514019 22375 heartbeater.cc:503] Master 127.20.81.62:44745 was elected leader, sending a full tablet report...
W20260808 14:35:41.542523 22376 tablet.cc:2369] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:35:41.631479 22221 tablet.cc:2369] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:35:41.710196 22530 tablet.cc:2369] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:35:41.796756 22561 raft_consensus.cc:482] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:41.796882 22561 raft_consensus.cc:504] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } }
I20260808 14:35:41.797240 22561 leader_election.cc:288] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2909c60e98d644fda9e669bf8138759d (127.20.81.1:46533), 662892a67a304a42a89412c6bb444119 (127.20.81.2:44859)
I20260808 14:35:41.800000 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.797527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:47079 (local address 127.20.81.1:46533)
0808 14:35:41.797571 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.797573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.797582 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:41.797624 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.797625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.797636 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.797703 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:41.797864 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.798349 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.799275 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.799642 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.799718 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.799730 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.799895 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.799933 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:35:41.800000 22411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.797443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:46533 (local address 127.20.81.3:47079)
0808 14:35:41.797488 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.797501 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.797551 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.797708 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.797709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.797710 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:41.797788 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.797789 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.798426 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.798427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.799178 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.799180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.799728 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.799729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.799809 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.799813 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.799887 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.799925 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":3}
I20260808 14:35:41.800186 22553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.797506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:57885 (local address 127.20.81.2:44859)
0808 14:35:41.797556 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.797559 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.797716 (+ 157us) server_negotiation.cc:407] Connection header received
0808 14:35:41.797787 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.797788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.797800 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.797872 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:41.798044 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.798508 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.799437 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.799790 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.799876 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.799885 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.800049 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.800093 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:35:41.800381 22564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.797477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:44859 (local address 127.20.81.3:57885)
0808 14:35:41.797629 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:41.797647 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:41.797726 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:41.797877 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:41.797877 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:41.797879 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:41.797972 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.797973 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.798597 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.798598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.799333 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:41.799334 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.799880 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.799881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:41.799970 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.799973 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:41.800041 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:35:41.800222 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":1,"thread_start_us":92,"threads_started":1}
I20260808 14:35:41.800355 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2affad08adb548d5815c6c3c4ca27ce7" candidate_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2909c60e98d644fda9e669bf8138759d" is_pre_election: true
I20260808 14:35:41.800519 22170 raft_consensus.cc:2454] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ae5c2bae88249c2a6dc264c57cd1b41 in term 0.
I20260808 14:35:41.800721 22323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2affad08adb548d5815c6c3c4ca27ce7" candidate_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "662892a67a304a42a89412c6bb444119" is_pre_election: true
I20260808 14:35:41.800782 22401 leader_election.cc:302] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2909c60e98d644fda9e669bf8138759d, 3ae5c2bae88249c2a6dc264c57cd1b41; no voters:
I20260808 14:35:41.800866 22323 raft_consensus.cc:2454] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ae5c2bae88249c2a6dc264c57cd1b41 in term 0.
I20260808 14:35:41.800936 22561 raft_consensus.cc:2781] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:41.800998 22561 raft_consensus.cc:482] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:41.801035 22561 raft_consensus.cc:3037] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:41.802210 22561 raft_consensus.cc:504] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } }
I20260808 14:35:41.802357 22561 leader_election.cc:288] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [CANDIDATE]: Term 1 election: Requested vote from peers 2909c60e98d644fda9e669bf8138759d (127.20.81.1:46533), 662892a67a304a42a89412c6bb444119 (127.20.81.2:44859)
I20260808 14:35:41.802520 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2affad08adb548d5815c6c3c4ca27ce7" candidate_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2909c60e98d644fda9e669bf8138759d"
I20260808 14:35:41.802572 22323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2affad08adb548d5815c6c3c4ca27ce7" candidate_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "662892a67a304a42a89412c6bb444119"
I20260808 14:35:41.802603 22170 raft_consensus.cc:3037] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:41.802687 22323 raft_consensus.cc:3037] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:41.803352 22170 raft_consensus.cc:2454] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ae5c2bae88249c2a6dc264c57cd1b41 in term 1.
I20260808 14:35:41.803377 22323 raft_consensus.cc:2454] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ae5c2bae88249c2a6dc264c57cd1b41 in term 1.
I20260808 14:35:41.803512 22401 leader_election.cc:302] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2909c60e98d644fda9e669bf8138759d, 3ae5c2bae88249c2a6dc264c57cd1b41; no voters:
I20260808 14:35:41.803599 22561 raft_consensus.cc:2781] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:41.803740 22561 raft_consensus.cc:686] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 LEADER]: Becoming Leader. State: Replica: 3ae5c2bae88249c2a6dc264c57cd1b41, State: Running, Role: LEADER
I20260808 14:35:41.803838 22561 consensus_queue.cc:237] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } }
I20260808 14:35:41.804688 21999 catalog_manager.cc:5495] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ae5c2bae88249c2a6dc264c57cd1b41 (127.20.81.3). New cstate: current_term: 1 leader_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } health_report { overall_health: UNKNOWN } } }
I20260808 14:35:41.857827 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:41.855032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55146 (local address 127.20.81.3:39625)
0808 14:35:41.855093 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:41.855095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:41.855104 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:41.855219 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:41.855220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:41.855244 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:41.855332 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:41.855477 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.855956 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.856934 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:41.857147 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:41.857225 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:41.857431 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:41.857539 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:41.857629 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:41.857688 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 14:35:41.857709 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:35:41.859916 22323 raft_consensus.cc:1261] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [term 1 FOLLOWER]: Refusing update from remote peer 3ae5c2bae88249c2a6dc264c57cd1b41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:41.859939 22170 raft_consensus.cc:1261] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Refusing update from remote peer 3ae5c2bae88249c2a6dc264c57cd1b41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:41.860296 22565 consensus_queue.cc:1035] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:41.860445 22561 consensus_queue.cc:1035] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:41.866868 21999 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:41.867035 21999 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:41.868001 21999 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561: Sending DeleteTablet for 3 replicas of tablet 2affad08adb548d5815c6c3c4ca27ce7
I20260808 14:35:41.868619 22458 tablet_service.cc:1514] Processing DeleteTablet for tablet 2affad08adb548d5815c6c3c4ca27ce7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:41 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:55132
I20260808 14:35:41.868654 22150 tablet_service.cc:1514] Processing DeleteTablet for tablet 2affad08adb548d5815c6c3c4ca27ce7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:41 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:39308
I20260808 14:35:41.868535 22301 tablet_service.cc:1514] Processing DeleteTablet for tablet 2affad08adb548d5815c6c3c4ca27ce7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:41 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:54908
I20260808 14:35:41.868808 21999 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:41.868942 21999 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:41.869030 22580 tablet_replica.cc:330] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: stopping tablet replica
I20260808 14:35:41.869145 22580 raft_consensus.cc:2229] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:41.869259 22580 raft_consensus.cc:2258] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:41.869340 22578 tablet_replica.cc:330] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: stopping tablet replica
I20260808 14:35:41.869438 22578 raft_consensus.cc:2229] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:41.869526 22578 raft_consensus.cc:2258] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:41.869853 22580 ts_tablet_manager.cc:1905] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:41.869977 22578 ts_tablet_manager.cc:1905] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:41.870942 22458 tablet_service.cc:1467] Processing CreateTablet for tablet ef6e9b4e91c64d4296cc396eaeb3a79b (DEFAULT_TABLE table=test-table [id=596f3bca09fb49f2b78138e2cae07e95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:41.871075 22458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef6e9b4e91c64d4296cc396eaeb3a79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:41.871665 22578 ts_tablet_manager.cc:1918] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:35:41.871735 22578 log.cc:1196] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/2affad08adb548d5815c6c3c4ca27ce7
I20260808 14:35:41.872038 22578 ts_tablet_manager.cc:1939] T 2affad08adb548d5815c6c3c4ca27ce7 P 2909c60e98d644fda9e669bf8138759d: Deleting consensus metadata
I20260808 14:35:41.872027 22580 ts_tablet_manager.cc:1918] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:35:41.872107 22580 log.cc:1196] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/2affad08adb548d5815c6c3c4ca27ce7
I20260808 14:35:41.872246 22579 tablet_replica.cc:330] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: stopping tablet replica
I20260808 14:35:41.872370 22579 raft_consensus.cc:2229] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:35:41.872383 22580 ts_tablet_manager.cc:1939] T 2affad08adb548d5815c6c3c4ca27ce7 P 662892a67a304a42a89412c6bb444119: Deleting consensus metadata
I20260808 14:35:41.872503 22579 raft_consensus.cc:2258] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:41.872794 22555 tablet_bootstrap.cc:492] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: Bootstrap starting.
I20260808 14:35:41.873239 22555 tablet_bootstrap.cc:654] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:41.873864 21985 catalog_manager.cc:4841] TS 662892a67a304a42a89412c6bb444119 (127.20.81.2:44859): tablet 2affad08adb548d5815c6c3c4ca27ce7 (table test-table [id=fa17a8c546b044bca713b3c2f1a395df]) successfully deleted
I20260808 14:35:41.874150 21984 catalog_manager.cc:4841] TS 2909c60e98d644fda9e669bf8138759d (127.20.81.1:46533): tablet 2affad08adb548d5815c6c3c4ca27ce7 (table test-table [id=fa17a8c546b044bca713b3c2f1a395df]) successfully deleted
I20260808 14:35:41.874279 22150 tablet_service.cc:1467] Processing CreateTablet for tablet ef6e9b4e91c64d4296cc396eaeb3a79b (DEFAULT_TABLE table=test-table [id=596f3bca09fb49f2b78138e2cae07e95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:41.874385 22150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef6e9b4e91c64d4296cc396eaeb3a79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:41.875331 22556 tablet_bootstrap.cc:492] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: Bootstrap starting.
I20260808 14:35:41.875463 22301 tablet_service.cc:1467] Processing CreateTablet for tablet ef6e9b4e91c64d4296cc396eaeb3a79b (DEFAULT_TABLE table=test-table [id=596f3bca09fb49f2b78138e2cae07e95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:41.875568 22301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef6e9b4e91c64d4296cc396eaeb3a79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:41.875716 22556 tablet_bootstrap.cc:654] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:41.876365 22556 tablet_bootstrap.cc:492] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: No bootstrap required, opened a new log
I20260808 14:35:41.876407 22556 ts_tablet_manager.cc:1397] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:41.876579 22556 raft_consensus.cc:348] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:41.876645 22556 raft_consensus.cc:374] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:41.876665 22556 raft_consensus.cc:729] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2909c60e98d644fda9e669bf8138759d, State: Initialized, Role: FOLLOWER
I20260808 14:35:41.876713 22556 consensus_queue.cc:260] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:41.876794 22560 tablet_bootstrap.cc:492] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: Bootstrap starting.
I20260808 14:35:41.876822 22556 ts_tablet_manager.cc:1428] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.877249 22560 tablet_bootstrap.cc:654] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:41.878463 22555 tablet_bootstrap.cc:492] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: No bootstrap required, opened a new log
I20260808 14:35:41.878525 22555 ts_tablet_manager.cc:1397] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 14:35:41.878703 22555 raft_consensus.cc:348] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:41.878782 22555 raft_consensus.cc:374] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:41.878808 22555 raft_consensus.cc:729] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae5c2bae88249c2a6dc264c57cd1b41, State: Initialized, Role: FOLLOWER
I20260808 14:35:41.878858 22555 consensus_queue.cc:260] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:41.878954 22555 ts_tablet_manager.cc:1428] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.879420 22560 tablet_bootstrap.cc:492] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: No bootstrap required, opened a new log
I20260808 14:35:41.879477 22560 ts_tablet_manager.cc:1397] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:35:41.879626 22560 raft_consensus.cc:348] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:41.879698 22560 raft_consensus.cc:374] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:41.879714 22560 raft_consensus.cc:729] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 662892a67a304a42a89412c6bb444119, State: Initialized, Role: FOLLOWER
I20260808 14:35:41.879748 22560 consensus_queue.cc:260] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:41.879868 22560 ts_tablet_manager.cc:1428] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:41.880944 22579 ts_tablet_manager.cc:1905] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:41.882601 22579 ts_tablet_manager.cc:1918] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:35:41.882684 22579 log.cc:1196] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/2affad08adb548d5815c6c3c4ca27ce7
I20260808 14:35:41.882932 22579 ts_tablet_manager.cc:1939] T 2affad08adb548d5815c6c3c4ca27ce7 P 3ae5c2bae88249c2a6dc264c57cd1b41: Deleting consensus metadata
I20260808 14:35:41.883390 21987 catalog_manager.cc:4841] TS 3ae5c2bae88249c2a6dc264c57cd1b41 (127.20.81.3:39625): tablet 2affad08adb548d5815c6c3c4ca27ce7 (table test-table [id=fa17a8c546b044bca713b3c2f1a395df]) successfully deleted
I20260808 14:35:42.098754 22563 raft_consensus.cc:482] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:42.098852 22563 raft_consensus.cc:504] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.099189 22563 leader_election.cc:288] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2909c60e98d644fda9e669bf8138759d (127.20.81.1:46533), 3ae5c2bae88249c2a6dc264c57cd1b41 (127.20.81.3:39625)
I20260808 14:35:42.102367 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.099506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:45991 (local address 127.20.81.1:46533)
0808 14:35:42.099557 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:42.099559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:42.099685 (+ 126us) server_negotiation.cc:407] Connection header received
0808 14:35:42.099760 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:42.099762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:42.099771 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:42.099845 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:42.100031 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.100741 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.101642 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.101989 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.102076 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.102086 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:42.102244 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 14:35:42.102286 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:35:42.102389 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.099483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:42181 (local address 127.20.81.3:39625)
0808 14:35:42.099553 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:42.099556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:42.099616 (+ 60us) server_negotiation.cc:407] Connection header received
0808 14:35:42.099721 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:42.099722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:42.099730 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:42.099793 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:42.099969 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.100532 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.101584 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.101989 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.102071 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.102083 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:42.102284 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 14:35:42.102327 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:35:42.102391 22585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.099422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:46533 (local address 127.20.81.2:45991)
0808 14:35:42.099614 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:42.099623 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:42.099702 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:42.099851 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:42.099852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:42.099866 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:42.099944 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.099952 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.100813 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.100814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.101520 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.101521 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.102107 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.102108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.102167 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.102171 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:35:42.102215 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:35:42.102266 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":103,"threads_started":1}
I20260808 14:35:42.102418 22584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.099372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39625 (local address 127.20.81.2:42181)
0808 14:35:42.099553 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:42.099565 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:42.099634 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:42.099798 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:42.099799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:42.099801 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:42.099882 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.099890 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.100622 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.100623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.101491 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.101494 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.102117 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.102118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.102189 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.102193 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:35:42.102266 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:35:42.102305 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":86,"threads_started":1}
I20260808 14:35:42.102620 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef6e9b4e91c64d4296cc396eaeb3a79b" candidate_uuid: "662892a67a304a42a89412c6bb444119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2909c60e98d644fda9e669bf8138759d" is_pre_election: true
I20260808 14:35:42.102706 22170 raft_consensus.cc:2454] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 662892a67a304a42a89412c6bb444119 in term 0.
I20260808 14:35:42.102826 22480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef6e9b4e91c64d4296cc396eaeb3a79b" candidate_uuid: "662892a67a304a42a89412c6bb444119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" is_pre_election: true
I20260808 14:35:42.102876 22248 leader_election.cc:302] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2909c60e98d644fda9e669bf8138759d, 662892a67a304a42a89412c6bb444119; no voters:
I20260808 14:35:42.103001 22480 raft_consensus.cc:2454] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 662892a67a304a42a89412c6bb444119 in term 0.
I20260808 14:35:42.103026 22563 raft_consensus.cc:2781] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:42.103067 22563 raft_consensus.cc:482] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:42.103089 22563 raft_consensus.cc:3037] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:42.103796 22563 raft_consensus.cc:504] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.103955 22563 leader_election.cc:288] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [CANDIDATE]: Term 1 election: Requested vote from peers 2909c60e98d644fda9e669bf8138759d (127.20.81.1:46533), 3ae5c2bae88249c2a6dc264c57cd1b41 (127.20.81.3:39625)
I20260808 14:35:42.104101 22480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef6e9b4e91c64d4296cc396eaeb3a79b" candidate_uuid: "662892a67a304a42a89412c6bb444119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41"
I20260808 14:35:42.104185 22480 raft_consensus.cc:3037] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:42.104595 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef6e9b4e91c64d4296cc396eaeb3a79b" candidate_uuid: "662892a67a304a42a89412c6bb444119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2909c60e98d644fda9e669bf8138759d"
I20260808 14:35:42.104676 22170 raft_consensus.cc:3037] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:42.105006 22480 raft_consensus.cc:2454] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 662892a67a304a42a89412c6bb444119 in term 1.
I20260808 14:35:42.105229 22251 leader_election.cc:302] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ae5c2bae88249c2a6dc264c57cd1b41, 662892a67a304a42a89412c6bb444119; no voters:
I20260808 14:35:42.105321 22563 raft_consensus.cc:2781] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:42.105389 22170 raft_consensus.cc:2454] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 662892a67a304a42a89412c6bb444119 in term 1.
I20260808 14:35:42.105464 22563 raft_consensus.cc:686] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 1 LEADER]: Becoming Leader. State: Replica: 662892a67a304a42a89412c6bb444119, State: Running, Role: LEADER
I20260808 14:35:42.105544 22563 consensus_queue.cc:237] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.106300 21999 catalog_manager.cc:5495] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 reported cstate change: term changed from 0 to 1, leader changed from <none> to 662892a67a304a42a89412c6bb444119 (127.20.81.2). New cstate: current_term: 1 leader_uuid: "662892a67a304a42a89412c6bb444119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:35:42 dist-test-slave-8n49 krb5kdc[21954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199740, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:42.180754 22594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.173290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44745 (local address 127.0.0.1:50296)
0808 14:35:42.173492 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:42.173505 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:42.173588 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:42.173766 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:42.173767 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:42.174118 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:42.174173 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.174175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.174867 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.174868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.175416 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.175418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.175800 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.175801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.175853 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.176399 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:42.176403 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:42.177932 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:42.179618 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:42.179626 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:42.179629 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:42.179833 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:42.180067 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:42.180068 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:42.180069 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:42.180143 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:42.180404 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:42.180411 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:42.180457 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:35:42.180516 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:35:42.180678 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
I20260808 14:35:42.180850 22595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.173417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50296 (local address 127.20.81.62:44745)
0808 14:35:42.173596 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:42.173598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:42.173610 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:35:42.173656 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:42.173657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:42.173669 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:42.173751 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:42.174257 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.174777 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.175513 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.175709 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.175770 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.178032 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:42.178033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:42.178033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:42.178040 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:42.179544 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:42.179918 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:42.179920 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:42.179920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:42.179991 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:42.180202 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:42.180203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:42.180203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:42.180313 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:42.180371 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:42.180602 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 14:35:42.180736 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":152,"thread_start_us":114,"threads_started":1}
I20260808 14:35:42.183183 21999 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:50296:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:35:42.183498 21999 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:42.185115 22150 tablet_service.cc:1467] Processing CreateTablet for tablet fa2287172cf246de8fd9cbe17f7bf8d2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f09d15c291ed40d596631555b4b4298a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:35:42.185199 22458 tablet_service.cc:1467] Processing CreateTablet for tablet fa2287172cf246de8fd9cbe17f7bf8d2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f09d15c291ed40d596631555b4b4298a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:35:42.185199 22301 tablet_service.cc:1467] Processing CreateTablet for tablet fa2287172cf246de8fd9cbe17f7bf8d2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f09d15c291ed40d596631555b4b4298a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:35:42.185350 22458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa2287172cf246de8fd9cbe17f7bf8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:42.185352 22150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa2287172cf246de8fd9cbe17f7bf8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:42.185356 22301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa2287172cf246de8fd9cbe17f7bf8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:42.186759 22556 tablet_bootstrap.cc:492] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: Bootstrap starting.
I20260808 14:35:42.186849 22555 tablet_bootstrap.cc:492] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: Bootstrap starting.
I20260808 14:35:42.187207 22556 tablet_bootstrap.cc:654] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:42.187206 22555 tablet_bootstrap.cc:654] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:42.187495 22560 tablet_bootstrap.cc:492] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: Bootstrap starting.
I20260808 14:35:42.187841 22556 tablet_bootstrap.cc:492] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: No bootstrap required, opened a new log
I20260808 14:35:42.187885 22556 ts_tablet_manager.cc:1397] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:42.187876 22555 tablet_bootstrap.cc:492] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: No bootstrap required, opened a new log
I20260808 14:35:42.187924 22555 ts_tablet_manager.cc:1397] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:42.187943 22560 tablet_bootstrap.cc:654] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:42.188014 22556 raft_consensus.cc:348] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.188074 22556 raft_consensus.cc:374] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:42.188088 22556 raft_consensus.cc:729] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2909c60e98d644fda9e669bf8138759d, State: Initialized, Role: FOLLOWER
I20260808 14:35:42.188050 22555 raft_consensus.cc:348] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.188160 22555 raft_consensus.cc:374] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:42.188146 22556 consensus_queue.cc:260] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.188186 22555 raft_consensus.cc:729] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae5c2bae88249c2a6dc264c57cd1b41, State: Initialized, Role: FOLLOWER
I20260808 14:35:42.188242 22556 ts_tablet_manager.cc:1428] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:42.188232 22555 consensus_queue.cc:260] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.188299 22559 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.188349 22555 ts_tablet_manager.cc:1428] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:42.188369 22559 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:42.188369 22575 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.188444 22575 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:42.189314 22560 tablet_bootstrap.cc:492] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: No bootstrap required, opened a new log
I20260808 14:35:42.189360 22560 ts_tablet_manager.cc:1397] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:35:42.189512 22560 raft_consensus.cc:348] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.189575 22560 raft_consensus.cc:374] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:42.189589 22560 raft_consensus.cc:729] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 662892a67a304a42a89412c6bb444119, State: Initialized, Role: FOLLOWER
I20260808 14:35:42.189651 22560 consensus_queue.cc:260] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.189744 22560 ts_tablet_manager.cc:1428] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:42.189816 22563 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.189921 22563 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:42.349140 22563 raft_consensus.cc:482] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:42.349295 22563 raft_consensus.cc:504] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.349517 22563 leader_election.cc:288] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2909c60e98d644fda9e669bf8138759d (127.20.81.1:46533), 3ae5c2bae88249c2a6dc264c57cd1b41 (127.20.81.3:39625)
I20260808 14:35:42.349802 22480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa2287172cf246de8fd9cbe17f7bf8d2" candidate_uuid: "662892a67a304a42a89412c6bb444119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" is_pre_election: true
I20260808 14:35:42.349805 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa2287172cf246de8fd9cbe17f7bf8d2" candidate_uuid: "662892a67a304a42a89412c6bb444119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2909c60e98d644fda9e669bf8138759d" is_pre_election: true
I20260808 14:35:42.349905 22170 raft_consensus.cc:2454] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 662892a67a304a42a89412c6bb444119 in term 0.
I20260808 14:35:42.349928 22480 raft_consensus.cc:2454] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 662892a67a304a42a89412c6bb444119 in term 0.
I20260808 14:35:42.350095 22248 leader_election.cc:302] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2909c60e98d644fda9e669bf8138759d, 662892a67a304a42a89412c6bb444119; no voters:
I20260808 14:35:42.350212 22563 raft_consensus.cc:2781] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:42.350274 22563 raft_consensus.cc:482] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:42.350291 22563 raft_consensus.cc:3037] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:42.351024 22563 raft_consensus.cc:504] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.351169 22563 leader_election.cc:288] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [CANDIDATE]: Term 1 election: Requested vote from peers 2909c60e98d644fda9e669bf8138759d (127.20.81.1:46533), 3ae5c2bae88249c2a6dc264c57cd1b41 (127.20.81.3:39625)
I20260808 14:35:42.351336 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa2287172cf246de8fd9cbe17f7bf8d2" candidate_uuid: "662892a67a304a42a89412c6bb444119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2909c60e98d644fda9e669bf8138759d"
I20260808 14:35:42.351347 22480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa2287172cf246de8fd9cbe17f7bf8d2" candidate_uuid: "662892a67a304a42a89412c6bb444119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41"
I20260808 14:35:42.351423 22480 raft_consensus.cc:3037] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:42.351424 22170 raft_consensus.cc:3037] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:42.351987 22170 raft_consensus.cc:2454] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 662892a67a304a42a89412c6bb444119 in term 1.
I20260808 14:35:42.352212 22480 raft_consensus.cc:2454] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 662892a67a304a42a89412c6bb444119 in term 1.
I20260808 14:35:42.352257 22248 leader_election.cc:302] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2909c60e98d644fda9e669bf8138759d, 662892a67a304a42a89412c6bb444119; no voters:
I20260808 14:35:42.352406 22563 raft_consensus.cc:2781] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:42.352494 22563 raft_consensus.cc:686] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [term 1 LEADER]: Becoming Leader. State: Replica: 662892a67a304a42a89412c6bb444119, State: Running, Role: LEADER
I20260808 14:35:42.352588 22563 consensus_queue.cc:237] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } }
I20260808 14:35:42.352903 22586 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: TxnStatusTablet state changed. Reason: New leader 662892a67a304a42a89412c6bb444119. Latest consensus state: current_term: 1 leader_uuid: "662892a67a304a42a89412c6bb444119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.353008 22586 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:35:42.353200 22600 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:35:42.353322 22600 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:35:42.353308 22001 catalog_manager.cc:5495] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 reported cstate change: term changed from 0 to 1, leader changed from <none> to 662892a67a304a42a89412c6bb444119 (127.20.81.2). New cstate: current_term: 1 leader_uuid: "662892a67a304a42a89412c6bb444119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } health_report { overall_health: UNKNOWN } } }
I20260808 14:35:42.372501 22594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.369739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:44859 (local address 127.0.0.1:54912)
0808 14:35:42.369820 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:42.369833 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:42.369888 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:42.370126 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:42.370127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:42.370129 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:35:42.370182 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.370184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.370907 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.370908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.371488 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.371489 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.371902 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.371904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.371970 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.371994 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:35:42.372280 (+ 286us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:35:42.372292 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:35:42.372338 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:35:42.372427 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:35:42.372479 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.369849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54912 (local address 127.20.81.2:44859)
0808 14:35:42.369967 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:42.369969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:42.369978 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:42.370010 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:42.370011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:42.370037 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:42.370119 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:42.370262 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.370802 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.371576 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.371809 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.371891 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.372092 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:42.372202 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:42.372285 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:42.372341 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 14:35:42.372363 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":51,"threads_started":1}
I20260808 14:35:42.373903 22170 raft_consensus.cc:1261] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Refusing update from remote peer 662892a67a304a42a89412c6bb444119: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:42.373937 22480 raft_consensus.cc:1261] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 FOLLOWER]: Refusing update from remote peer 662892a67a304a42a89412c6bb444119: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:42.374167 22563 consensus_queue.cc:1035] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:42.374300 22586 consensus_queue.cc:1035] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:42.374994 22559 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: TxnStatusTablet state changed. Reason: New leader 662892a67a304a42a89412c6bb444119. Latest consensus state: current_term: 1 leader_uuid: "662892a67a304a42a89412c6bb444119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.375088 22559 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:42.375061 22575 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: TxnStatusTablet state changed. Reason: New leader 662892a67a304a42a89412c6bb444119. Latest consensus state: current_term: 1 leader_uuid: "662892a67a304a42a89412c6bb444119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.375155 22575 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:42.376016 22563 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "662892a67a304a42a89412c6bb444119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.376103 22563 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:35:42.376205 22575 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "662892a67a304a42a89412c6bb444119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.376304 22575 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 3ae5c2bae88249c2a6dc264c57cd1b41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:42.376888 22608 mvcc.cc:205] Tried to move back new op lower bound from 7316274144761159680 to 7316274144676642816. Current Snapshot: MvccSnapshot[applied={T|T < 7316274144761159680}]
I20260808 14:35:42.377249 22563 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "662892a67a304a42a89412c6bb444119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.377334 22563 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 662892a67a304a42a89412c6bb444119: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:35:42.377496 22606 mvcc.cc:205] Tried to move back new op lower bound from 7316274144761159680 to 7316274144676642816. Current Snapshot: MvccSnapshot[applied={T|T < 7316274144761159680}]
I20260808 14:35:42.377617 22559 tablet_replica.cc:439] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "662892a67a304a42a89412c6bb444119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 } } peers { permanent_uuid: "662892a67a304a42a89412c6bb444119" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 44859 } } peers { permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 } } }
I20260808 14:35:42.377703 22559 tablet_replica.cc:442] T fa2287172cf246de8fd9cbe17f7bf8d2 P 2909c60e98d644fda9e669bf8138759d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:42.383638 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.380966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54922 (local address 127.20.81.2:44859)
0808 14:35:42.381005 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:42.381008 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:42.381131 (+ 123us) server_negotiation.cc:407] Connection header received
0808 14:35:42.381202 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:42.381203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:42.381215 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:42.381275 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:42.381398 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.381899 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.382834 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.383037 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.383113 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.383270 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:42.383310 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:42.383381 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:42.383514 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 14:35:42.383537 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:35:42.388758 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.386160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:51421 (local address 127.20.81.2:44859)
0808 14:35:42.386198 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:42.386201 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:42.386325 (+ 124us) server_negotiation.cc:407] Connection header received
0808 14:35:42.386598 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:42.386598 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:42.386607 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:42.386661 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:42.386809 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.387241 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.388000 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.388185 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.388257 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.388445 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:42.388480 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:42.388538 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:42.388657 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 14:35:42.388676 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:35:42.388856 22619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.386111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:44859 (local address 127.20.81.2:51421)
0808 14:35:42.386249 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:42.386259 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:42.386528 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:42.386668 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:42.386669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:42.386670 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:35:42.386729 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.386730 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.387322 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.387323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.387912 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:42.387914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.388268 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.388270 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:42.388325 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.388348 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:35:42.388599 (+ 251us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:35:42.388601 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:35:42.388652 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:35:42.388704 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":11,"thread_start_us":80,"threads_started":1}
I20260808 14:35:42.391510 22170 raft_consensus.cc:1261] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Refusing update from remote peer 662892a67a304a42a89412c6bb444119: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:42.391510 22480 raft_consensus.cc:1261] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 FOLLOWER]: Refusing update from remote peer 662892a67a304a42a89412c6bb444119: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:42.391731 22563 consensus_queue.cc:1035] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ae5c2bae88249c2a6dc264c57cd1b41" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:42.391909 22620 consensus_queue.cc:1035] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2909c60e98d644fda9e669bf8138759d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:42.393172 22605 mvcc.cc:205] Tried to move back new op lower bound from 7316274144834351104 to 7316274143664771072. Current Snapshot: MvccSnapshot[applied={T|T < 7316274144834351104}]
I20260808 14:35:42.404536 21999 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:42.404665 21999 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:42.405337 21999 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1910eb3b0a0e47589fb7c4cb43cd1561: Sending DeleteTablet for 3 replicas of tablet ef6e9b4e91c64d4296cc396eaeb3a79b
I20260808 14:35:42.405601 22150 tablet_service.cc:1514] Processing DeleteTablet for tablet ef6e9b4e91c64d4296cc396eaeb3a79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:42 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:39308
I20260808 14:35:42.405653 22458 tablet_service.cc:1514] Processing DeleteTablet for tablet ef6e9b4e91c64d4296cc396eaeb3a79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:42 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:55132
I20260808 14:35:42.405705 22300 tablet_service.cc:1514] Processing DeleteTablet for tablet ef6e9b4e91c64d4296cc396eaeb3a79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:42 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:54908
I20260808 14:35:42.405891 22626 tablet_replica.cc:330] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: stopping tablet replica
I20260808 14:35:42.405954 22626 raft_consensus.cc:2229] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:35:42.406031 22626 raft_consensus.cc:2258] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:42.406139 22624 tablet_replica.cc:330] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: stopping tablet replica
I20260808 14:35:42.406196 22624 raft_consensus.cc:2229] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:42.406234 22624 raft_consensus.cc:2258] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:42.406483 22624 ts_tablet_manager.cc:1905] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:42.408496 22626 ts_tablet_manager.cc:1905] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:42.408536 22624 ts_tablet_manager.cc:1918] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:35:42.408630 22624 log.cc:1196] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/ef6e9b4e91c64d4296cc396eaeb3a79b
I20260808 14:35:42.408864 22624 ts_tablet_manager.cc:1939] T ef6e9b4e91c64d4296cc396eaeb3a79b P 2909c60e98d644fda9e669bf8138759d: Deleting consensus metadata
I20260808 14:35:42.409301 21984 catalog_manager.cc:4841] TS 2909c60e98d644fda9e669bf8138759d (127.20.81.1:46533): tablet ef6e9b4e91c64d4296cc396eaeb3a79b (table test-table [id=596f3bca09fb49f2b78138e2cae07e95]) successfully deleted
I20260808 14:35:42.410399 22626 ts_tablet_manager.cc:1918] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:35:42.410472 22626 log.cc:1196] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/ef6e9b4e91c64d4296cc396eaeb3a79b
I20260808 14:35:42.410714 22626 ts_tablet_manager.cc:1939] T ef6e9b4e91c64d4296cc396eaeb3a79b P 662892a67a304a42a89412c6bb444119: Deleting consensus metadata
I20260808 14:35:42.411252 21985 catalog_manager.cc:4841] TS 662892a67a304a42a89412c6bb444119 (127.20.81.2:44859): tablet ef6e9b4e91c64d4296cc396eaeb3a79b (table test-table [id=596f3bca09fb49f2b78138e2cae07e95]) successfully deleted
I20260808 14:35:42.412637 22625 tablet_replica.cc:330] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: stopping tablet replica
I20260808 14:35:42.412717 22625 raft_consensus.cc:2229] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:42.412767 22625 raft_consensus.cc:2258] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:42.413026 22625 ts_tablet_manager.cc:1905] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:42.414677 22625 ts_tablet_manager.cc:1918] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:35:42.414736 22625 log.cc:1196] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/ef6e9b4e91c64d4296cc396eaeb3a79b
I20260808 14:35:42.414961 22625 ts_tablet_manager.cc:1939] T ef6e9b4e91c64d4296cc396eaeb3a79b P 3ae5c2bae88249c2a6dc264c57cd1b41: Deleting consensus metadata
I20260808 14:35:42.415280 21987 catalog_manager.cc:4841] TS 3ae5c2bae88249c2a6dc264c57cd1b41 (127.20.81.3:39625): tablet ef6e9b4e91c64d4296cc396eaeb3a79b (table test-table [id=596f3bca09fb49f2b78138e2cae07e95]) successfully deleted
Aug 08 14:35:42 dist-test-slave-8n49 krb5kdc[21954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199741, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:35:42.422441 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.413032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39312 (local address 127.20.81.1:46533)
0808 14:35:42.413094 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:42.413096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:42.413274 (+ 178us) server_negotiation.cc:407] Connection header received
0808 14:35:42.413331 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:42.413332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:42.413344 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:42.413407 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:42.414094 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.414836 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.415945 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.416135 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.416190 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.419517 (+ 3327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:42.419527 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:42.419528 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:42.419536 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:42.421201 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:42.421585 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:42.421588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:42.421589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:42.421664 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:42.421886 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:42.421887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:42.421888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:42.422033 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:42.422191 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:42.422258 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 14:35:42.422341 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 14:35:42.422844 22214 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39312
I20260808 14:35:42.430092 22595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:42.423958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50298 (local address 127.20.81.62:44745)
0808 14:35:42.424016 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:42.424019 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:42.424028 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:42.424092 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:42.424093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:42.424109 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:42.424164 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:42.424744 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.425245 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.425937 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:42.426170 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:42.426247 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:42.427430 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:42.427431 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:42.427432 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:42.427439 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:42.428966 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:42.429300 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:42.429301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:42.429301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:42.429358 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:42.429564 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:42.429565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:42.429566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:42.429681 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:42.429787 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:42.429896 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 14:35:42.429978 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260808 14:35:42.430339 21999 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50298
I20260808 14:35:42.430932 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 22078
I20260808 14:35:42.438985 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 22229
I20260808 14:35:42.446640 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 22384
I20260808 14:35:42.453649 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 21967
2026-08-08T14:35:42Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2869 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:42 dist-test-slave-8n49 krb5kdc[22634](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:42 dist-test-slave-8n49 krb5kdc[22634](info): set up 2 sockets
Aug 08 14:35:42 dist-test-slave-8n49 krb5kdc[22634](info): commencing operation
krb5kdc: starting...
W20260808 14:35:43.542959 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:35:43 dist-test-slave-8n49 krb5kdc[22634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:35:43.664860 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:36725
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:36725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:43.746955 22648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:43.747159 22648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:43.747181 22648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:43.748375 22648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:43.748418 22648 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:35:43.748432 22648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:43.748445 22648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:43.748457 22648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:43.748476 22648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:43.749958 22648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:36725
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:36725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:43.750155 22648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:43.750320 22648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:43.755174 22653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:43.755218 22656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:43.755457 22648 server_base.cc:1034] running on GCE node
W20260808 14:35:43.755172 22654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:43.755753 22648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:43.756031 22648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:43.757180 22648 hybrid_clock.cc:648] HybridClock initialized: now 1786199743757168 us; error 31 us; skew 500 ppm
Aug 08 14:35:43 dist-test-slave-8n49 krb5kdc[22634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199743, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:43.759891 22648 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:35:43.760273 22648 webserver.cc:460] Webserver started at http://127.20.81.62:42331/ using document root <none> and password file <none>
I20260808 14:35:43.760455 22648 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:43.760494 22648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:43.760645 22648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:43.761653 22648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "5cac30b278d14f13900b335de8b68437"
format_stamp: "Formatted at 2026-08-08 14:35:43 on dist-test-slave-8n49"
server_key: "0ec7ae6feccffab1105f1c6d348455ab"
server_key_iv: "577b9d501dd762c4083aa27f951bba05"
server_key_version: "encryptionkey@0"
I20260808 14:35:43.761963 22648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "5cac30b278d14f13900b335de8b68437"
format_stamp: "Formatted at 2026-08-08 14:35:43 on dist-test-slave-8n49"
server_key: "0ec7ae6feccffab1105f1c6d348455ab"
server_key_iv: "577b9d501dd762c4083aa27f951bba05"
server_key_version: "encryptionkey@0"
I20260808 14:35:43.763262 22648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:35:43.763953 22663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:43.764128 22648 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:43.764231 22648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "5cac30b278d14f13900b335de8b68437"
format_stamp: "Formatted at 2026-08-08 14:35:43 on dist-test-slave-8n49"
server_key: "0ec7ae6feccffab1105f1c6d348455ab"
server_key_iv: "577b9d501dd762c4083aa27f951bba05"
server_key_version: "encryptionkey@0"
I20260808 14:35:43.764314 22648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:43.774008 22648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:43.775859 22648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:43.776019 22648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:43.780731 22648 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:36725
I20260808 14:35:43.780839 22727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:36725 every 8 connection(s)
I20260808 14:35:43.781145 22648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:43.781796 22728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:43.784113 22728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437: Bootstrap starting.
I20260808 14:35:43.784785 22728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:43.785089 22728 log.cc:824] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:43.785776 22728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437: No bootstrap required, opened a new log
I20260808 14:35:43.787979 22728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cac30b278d14f13900b335de8b68437" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 36725 } }
I20260808 14:35:43.788117 22728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:43.788165 22728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cac30b278d14f13900b335de8b68437, State: Initialized, Role: FOLLOWER
I20260808 14:35:43.788334 22728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cac30b278d14f13900b335de8b68437" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 36725 } }
I20260808 14:35:43.788421 22728 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:43.788473 22728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:43.788523 22728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:43.789081 22728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cac30b278d14f13900b335de8b68437" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 36725 } }
I20260808 14:35:43.789167 22728 leader_election.cc:302] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cac30b278d14f13900b335de8b68437; no voters:
I20260808 14:35:43.789299 22728 leader_election.cc:288] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:43.789361 22731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:43.789528 22731 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [term 1 LEADER]: Becoming Leader. State: Replica: 5cac30b278d14f13900b335de8b68437, State: Running, Role: LEADER
I20260808 14:35:43.789572 22728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:43.789635 22731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cac30b278d14f13900b335de8b68437" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 36725 } }
I20260808 14:35:43.789729 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 22648
I20260808 14:35:43.789858 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:43.789942 22733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cac30b278d14f13900b335de8b68437. Latest consensus state: current_term: 1 leader_uuid: "5cac30b278d14f13900b335de8b68437" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cac30b278d14f13900b335de8b68437" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 36725 } } }
I20260808 14:35:43.789942 22732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cac30b278d14f13900b335de8b68437" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cac30b278d14f13900b335de8b68437" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 36725 } } }
I20260808 14:35:43.790045 20804 external_mini_cluster.cc:1428] Setting key 24ed8445c6e5d09b3a7536471eae7f81
I20260808 14:35:43.790055 22733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:43.790059 22732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:43.790330 22736 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:43.790937 22736 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:43.792706 22736 catalog_manager.cc:1347] Generated new cluster ID: e0fbfdaac318484f936867dad94b548b
I20260808 14:35:43.792758 22736 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:35:43 dist-test-slave-8n49 krb5kdc[22634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:43.800292 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:43.790685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44184 (local address 127.20.81.62:36725)
0808 14:35:43.790868 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:43.790880 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:43.790921 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:35:43.791109 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:43.791118 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:43.791179 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:43.791327 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:43.792094 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.793303 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.794062 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.794506 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.794646 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:43.796998 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:43.797003 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:43.797004 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:43.797020 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:43.798698 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:43.799078 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:43.799081 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:43.799081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:43.799185 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:43.799398 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:43.799399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:43.799399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:43.799654 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:43.799816 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:43.799934 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 14:35:43.800088 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260808 14:35:43.810786 22736 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:43.811530 22736 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:43.814851 22736 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437: Generated new TSK 0
I20260808 14:35:43.815019 22736 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:35:43.843204 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:36725
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:43.926502 22756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:43.926700 22756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:43.926726 22756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:43.927846 22756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:43.927888 22756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:43.927909 22756 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:35:43.927922 22756 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:35:43.927938 22756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:35:43.929486 22756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.81.62:36725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:43.929742 22756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:43.930003 22756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:43.935086 22762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:43.935101 22763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:43.935305 22756 server_base.cc:1034] running on GCE node
W20260808 14:35:43.935108 22765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:43.935555 22756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:43.935806 22756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:43.936970 22756 hybrid_clock.cc:648] HybridClock initialized: now 1786199743936968 us; error 37 us; skew 500 ppm
Aug 08 14:35:43 dist-test-slave-8n49 krb5kdc[22634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199743, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:43.939869 22756 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:35:43.940327 22756 webserver.cc:460] Webserver started at http://127.20.81.1:32935/ using document root <none> and password file <none>
I20260808 14:35:43.940642 22756 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:43.940714 22756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:43.940873 22756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:43.941948 22756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "0ce28a9407f74172965f7e90160ec1fb"
format_stamp: "Formatted at 2026-08-08 14:35:43 on dist-test-slave-8n49"
server_key: "5f86cadd55f568d6352109580a5dc13c"
server_key_iv: "be0f0b2382c47f60ce6ee464b4c83260"
server_key_version: "encryptionkey@0"
I20260808 14:35:43.942314 22756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "0ce28a9407f74172965f7e90160ec1fb"
format_stamp: "Formatted at 2026-08-08 14:35:43 on dist-test-slave-8n49"
server_key: "5f86cadd55f568d6352109580a5dc13c"
server_key_iv: "be0f0b2382c47f60ce6ee464b4c83260"
server_key_version: "encryptionkey@0"
I20260808 14:35:43.943751 22756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:35:43.944669 22773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:43.944857 22756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:43.944957 22756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "0ce28a9407f74172965f7e90160ec1fb"
format_stamp: "Formatted at 2026-08-08 14:35:43 on dist-test-slave-8n49"
server_key: "5f86cadd55f568d6352109580a5dc13c"
server_key_iv: "be0f0b2382c47f60ce6ee464b4c83260"
server_key_version: "encryptionkey@0"
I20260808 14:35:43.945048 22756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:43.957466 22756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:43.959517 22756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:43.959689 22756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:43.960204 22756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:43.960266 22756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:43.960318 22756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:43.960350 22756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:43.967631 22756 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:42425
I20260808 14:35:43.967800 22898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:42425 every 8 connection(s)
I20260808 14:35:43.968058 22756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:35:43 dist-test-slave-8n49 krb5kdc[22634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199743, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:43.968696 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 22756
I20260808 14:35:43.968802 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:43.969015 20804 external_mini_cluster.cc:1428] Setting key 75ace0f77fdf42fc1f0b23722077eb16
I20260808 14:35:43.972384 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:43.960836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:51897 (local address 127.20.81.62:36725)
0808 14:35:43.960883 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:43.960887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:43.961137 (+ 250us) server_negotiation.cc:407] Connection header received
0808 14:35:43.961754 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:43.961756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:43.961771 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:43.961836 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:43.962853 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.963728 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.965573 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.965826 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.965915 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:43.969077 (+ 3162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:43.969079 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:43.969080 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:43.969087 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:43.970842 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:43.971279 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:43.971280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:43.971281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:43.971350 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:43.971703 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:43.971704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:43.971705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:43.971817 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:43.971873 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:43.972249 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 14:35:43.972320 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:35:43.972759 22783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:43.960810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:36725 (local address 127.20.81.1:51897)
0808 14:35:43.961004 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:43.961043 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:43.961623 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:43.961940 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:43.961945 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:43.962383 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:43.962727 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:43.962735 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.963846 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.963847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:43.965467 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:43.965486 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.965925 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.965926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:43.966111 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:43.966816 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:43.966825 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:43.968964 (+ 2139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:43.970951 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:43.970958 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:43.970960 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:43.971198 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:43.971420 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:43.971421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:43.971421 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:43.971611 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:43.971890 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:43.971897 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:43.972099 (+ 202us) client_negotiation.cc:769] Sending connection context
0808 14:35:43.972231 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 14:35:43.972451 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":126,"threads_started":1}
I20260808 14:35:43.973315 22899 heartbeater.cc:347] Connected to a master server at 127.20.81.62:36725
I20260808 14:35:43.973430 22899 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:43.973620 22899 heartbeater.cc:511] Master 127.20.81.62:36725 requested a full tablet report, sending...
I20260808 14:35:43.974184 22679 ts_manager.cc:194] Registered new tserver with Master: 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425)
I20260808 14:35:43.975018 22679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:51897
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
I20260808 14:35:43.982834 22907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:43.974469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:36725 (local address 127.20.81.1:60649)
0808 14:35:43.976674 (+ 2205us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:43.976689 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:43.976769 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:43.976903 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:43.976904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:43.977152 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:43.977226 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:43.977229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.977877 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.977878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:43.978873 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:43.978877 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.979280 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.979282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:43.979373 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:43.979807 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:43.979813 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:43.980260 (+ 447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:43.981807 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:43.981808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:43.981809 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:43.982022 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:43.982256 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:43.982257 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:43.982257 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:43.982313 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:43.982538 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:43.982539 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:43.982591 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 14:35:43.982668 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:35:43.982749 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2169,"thread_start_us":85,"threads_started":1}
I20260808 14:35:43.983007 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:43.974554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:60649 (local address 127.20.81.62:36725)
0808 14:35:43.974599 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:43.974602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:43.976761 (+ 2159us) server_negotiation.cc:407] Connection header received
0808 14:35:43.976836 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:43.976837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:43.976846 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:43.976893 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:43.977306 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.977765 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.979018 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:43.979195 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:43.979245 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:43.980339 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:43.980340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:43.980340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:43.980346 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:43.981724 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:43.982119 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:43.982120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:43.982121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:43.982182 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:43.982374 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:43.982375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:43.982376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:43.982474 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:43.982527 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:43.982739 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:35:43.982841 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:35:44.000423 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:36725
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:44.085263 22909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:44.085484 22909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:44.085510 22909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:44.086654 22909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:44.086697 22909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:44.086717 22909 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:35:44.086730 22909 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:35:44.086789 22909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:35:44.088218 22909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.81.62:36725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:44.088477 22909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:44.088734 22909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:44.094055 22917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:44.094033 22915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:44.094141 22909 server_base.cc:1034] running on GCE node
W20260808 14:35:44.094167 22914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:44.094434 22909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:44.094695 22909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:44.095892 22909 hybrid_clock.cc:648] HybridClock initialized: now 1786199744095875 us; error 25 us; skew 500 ppm
Aug 08 14:35:44 dist-test-slave-8n49 krb5kdc[22634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199744, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:44.098407 22909 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:35:44.098855 22909 webserver.cc:460] Webserver started at http://127.20.81.2:45087/ using document root <none> and password file <none>
I20260808 14:35:44.099092 22909 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:44.099160 22909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:44.099319 22909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:44.100420 22909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "1f02c33d5829488f85b65059b4058d99"
format_stamp: "Formatted at 2026-08-08 14:35:44 on dist-test-slave-8n49"
server_key: "cda0eedaa04fa5ebe8e30ecbd8052d48"
server_key_iv: "f3a0e5ef7f0a27fa90384ec315de73b3"
server_key_version: "encryptionkey@0"
I20260808 14:35:44.100840 22909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "1f02c33d5829488f85b65059b4058d99"
format_stamp: "Formatted at 2026-08-08 14:35:44 on dist-test-slave-8n49"
server_key: "cda0eedaa04fa5ebe8e30ecbd8052d48"
server_key_iv: "f3a0e5ef7f0a27fa90384ec315de73b3"
server_key_version: "encryptionkey@0"
I20260808 14:35:44.102172 22909 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:44.102882 22924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:44.103049 22909 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:44.103155 22909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "1f02c33d5829488f85b65059b4058d99"
format_stamp: "Formatted at 2026-08-08 14:35:44 on dist-test-slave-8n49"
server_key: "cda0eedaa04fa5ebe8e30ecbd8052d48"
server_key_iv: "f3a0e5ef7f0a27fa90384ec315de73b3"
server_key_version: "encryptionkey@0"
I20260808 14:35:44.103229 22909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:44.120673 22909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:44.122509 22909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:44.122674 22909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:44.123270 22909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:44.123329 22909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:44.123365 22909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:44.123389 22909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:35:44 dist-test-slave-8n49 krb5kdc[22634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199744, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:44.130987 22909 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:42681
I20260808 14:35:44.131096 23047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:42681 every 8 connection(s)
I20260808 14:35:44.131454 22909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:35:44.133086 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.123688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:47769 (local address 127.20.81.62:36725)
0808 14:35:44.123766 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.123770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.124019 (+ 249us) server_negotiation.cc:407] Connection header received
0808 14:35:44.124513 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.124515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.124529 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.124621 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:44.125268 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.125832 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.126873 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.127080 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.127158 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.129872 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:44.129874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:44.129875 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:44.129883 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:44.131564 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.132047 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.132048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.132048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.132111 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.132379 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.132380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.132380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.132515 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:44.132668 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.132944 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.133023 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:35:44.133244 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.123675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:36725 (local address 127.20.81.2:47769)
0808 14:35:44.123873 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.123915 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.124406 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.124686 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.124690 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.124917 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:44.125169 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.125174 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.125912 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.125914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.126772 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.126776 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.127165 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.127167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.127313 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.127868 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:44.127888 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:44.129771 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:44.131637 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.131643 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.131646 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.131966 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.132176 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.132177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.132177 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.132276 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.132656 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:44.132664 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:44.132793 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.132901 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.133040 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":129,"threads_started":1}
I20260808 14:35:44.133766 23048 heartbeater.cc:347] Connected to a master server at 127.20.81.62:36725
I20260808 14:35:44.133854 23048 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:44.134044 23048 heartbeater.cc:511] Master 127.20.81.62:36725 requested a full tablet report, sending...
I20260808 14:35:44.134743 22680 ts_manager.cc:194] Registered new tserver with Master: 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681)
I20260808 14:35:44.135324 22680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:47769
I20260808 14:35:44.136094 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 22909
I20260808 14:35:44.136224 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:44.136408 20804 external_mini_cluster.cc:1428] Setting key e78ac4f08a658fc1c2c924e1f22f0762
I20260808 14:35:44.140841 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.134728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:36725 (local address 127.20.81.2:53595)
0808 14:35:44.134884 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.134896 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.134959 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.135092 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.135093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.135288 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:44.135351 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.135353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.136090 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.136092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.136885 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.136888 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.137337 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.137338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.137401 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.137846 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:44.137851 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:44.138134 (+ 283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:44.139703 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.139704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.139705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.139935 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.140146 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.140147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.140147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.140198 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.140534 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:44.140535 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:44.140635 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.140702 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.140777 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":88,"threads_started":1}
I20260808 14:35:44.141229 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.134837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:53595 (local address 127.20.81.62:36725)
0808 14:35:44.134881 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.134883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.134944 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:35:44.135016 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.135017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.135025 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.135071 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:44.135429 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.135981 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.136968 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.137258 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.137332 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.138218 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:44.138219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:44.138220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:44.138227 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:44.139619 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.140008 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.140009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.140009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.140070 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.140260 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.140261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.140262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.140461 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:44.140533 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.140749 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.140834 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:35:44.163497 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:36725
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:44.246312 23058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:44.246520 23058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:44.246546 23058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:44.247697 23058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:44.247740 23058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:44.247759 23058 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:35:44.247771 23058 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:35:44.247788 23058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:35:44.249375 23058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.81.62:36725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:44.249562 23058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:44.249737 23058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:44.254817 23064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:44.254822 23067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:44.254945 23058 server_base.cc:1034] running on GCE node
W20260808 14:35:44.254828 23065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:44.255266 23058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:44.255507 23058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:44.256628 23058 hybrid_clock.cc:648] HybridClock initialized: now 1786199744256607 us; error 34 us; skew 500 ppm
Aug 08 14:35:44 dist-test-slave-8n49 krb5kdc[22634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199744, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:44.259215 23058 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:35:44.259658 23058 webserver.cc:460] Webserver started at http://127.20.81.3:43233/ using document root <none> and password file <none>
I20260808 14:35:44.259907 23058 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:44.259963 23058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:44.260128 23058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:44.261247 23058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4"
format_stamp: "Formatted at 2026-08-08 14:35:44 on dist-test-slave-8n49"
server_key: "ba38cbd3c766c0e1ad2c9c5e8caaf753"
server_key_iv: "0e61722b337fab75be6c0d81032f9df9"
server_key_version: "encryptionkey@0"
I20260808 14:35:44.261610 23058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4"
format_stamp: "Formatted at 2026-08-08 14:35:44 on dist-test-slave-8n49"
server_key: "ba38cbd3c766c0e1ad2c9c5e8caaf753"
server_key_iv: "0e61722b337fab75be6c0d81032f9df9"
server_key_version: "encryptionkey@0"
I20260808 14:35:44.262916 23058 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:35:44.263603 23074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:44.263777 23058 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:44.263867 23058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4"
format_stamp: "Formatted at 2026-08-08 14:35:44 on dist-test-slave-8n49"
server_key: "ba38cbd3c766c0e1ad2c9c5e8caaf753"
server_key_iv: "0e61722b337fab75be6c0d81032f9df9"
server_key_version: "encryptionkey@0"
I20260808 14:35:44.263959 23058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:44.282305 23058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:44.284790 23058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:44.284967 23058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:44.285514 23058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:44.285583 23058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:44.285622 23058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:44.285646 23058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:35:44 dist-test-slave-8n49 krb5kdc[22634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199744, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:44.293097 23058 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:39509
I20260808 14:35:44.293174 23195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:39509 every 8 connection(s)
I20260808 14:35:44.293473 23058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:44.296243 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.286129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:59373 (local address 127.20.81.62:36725)
0808 14:35:44.286178 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.286181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.286431 (+ 250us) server_negotiation.cc:407] Connection header received
0808 14:35:44.286978 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.286979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.286991 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.287068 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:44.288060 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.288827 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.290630 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.290947 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.291041 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.293546 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:44.293547 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:44.293547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:44.293555 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:44.295113 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.295474 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.295475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.295475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.295527 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.295741 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.295741 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.295741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.295843 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:44.295892 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.296119 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.296181 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:35:44.296445 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.286133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:36725 (local address 127.20.81.3:59373)
0808 14:35:44.286313 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.286348 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.286869 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.287195 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.287201 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.287620 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:44.287945 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.287953 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.288969 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.288971 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.290542 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.290546 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.291043 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.291044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.291201 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.291786 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:44.291799 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:44.293446 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:44.295183 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.295188 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.295190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.295399 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.295587 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.295587 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.295588 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.295687 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.295898 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:44.295902 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:44.296009 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.296089 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.296206 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260808 14:35:44.296916 23196 heartbeater.cc:347] Connected to a master server at 127.20.81.62:36725
I20260808 14:35:44.296996 23196 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:44.297195 23196 heartbeater.cc:511] Master 127.20.81.62:36725 requested a full tablet report, sending...
I20260808 14:35:44.297618 22679 ts_manager.cc:194] Registered new tserver with Master: 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3:39509)
I20260808 14:35:44.298146 22679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:59373
I20260808 14:35:44.298892 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 23058
I20260808 14:35:44.299008 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:44.299187 20804 external_mini_cluster.cc:1428] Setting key 9012e1f9ed4ceacb8706b674a680dd79
I20260808 14:35:44.300006 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:35:44.303943 23203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.297927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:36725 (local address 127.20.81.3:38931)
0808 14:35:44.298095 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.298105 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.298165 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.298309 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.298310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.298483 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:44.298541 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.298543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.299450 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.299452 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.299953 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.299955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.300376 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.300377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.300451 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.300918 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:44.300924 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:44.301205 (+ 281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:44.303019 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.303020 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.303020 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.303190 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.303395 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.303395 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.303395 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.303446 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.303715 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:44.303715 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:44.303750 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.303800 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.303873 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":105,"threads_started":1}
I20260808 14:35:44.304035 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.298009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:38931 (local address 127.20.81.62:36725)
0808 14:35:44.298052 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.298054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.298159 (+ 105us) server_negotiation.cc:407] Connection header received
0808 14:35:44.298227 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.298228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.298238 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.298289 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:44.298619 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.299346 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.300056 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.300300 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.300378 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.301316 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:44.301317 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:44.301317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:44.301324 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:44.302930 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.303264 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.303265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.303266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.303325 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.303510 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.303511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.303511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.303650 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:44.303719 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.303826 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.303905 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 14:35:44 dist-test-slave-8n49 krb5kdc[22634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:35:44 dist-test-slave-8n49 krb5kdc[22634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:44.324186 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.317712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44196 (local address 127.20.81.62:36725)
0808 14:35:44.317775 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.317777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.317786 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:44.317822 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.317824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.317833 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.317884 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:44.318465 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.318949 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.319647 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.319825 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.319874 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.322111 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:44.322113 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:44.322113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:44.322119 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:44.323276 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.323567 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.323568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.323568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.323617 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.323779 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.323780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.323780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.323879 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:44.323953 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.324040 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.324094 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:35:44.325994 22679 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:44.327646 22679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:44.334545 23219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.330180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:42681 (local address 127.0.0.1:52014)
0808 14:35:44.330414 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.330479 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.330548 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.330955 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.330959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.330961 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:44.331042 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.331044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.332140 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.332141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.333256 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.333259 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.334218 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.334219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.334297 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.334312 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.334377 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.334439 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":50,"threads_started":1}
I20260808 14:35:44.334561 23222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.330584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52014 (local address 127.20.81.2:42681)
0808 14:35:44.330757 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.330762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.330774 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:35:44.330817 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.330819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.330834 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.331120 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:44.331184 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.332054 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.333371 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.334121 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.334200 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.334269 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.334410 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.334452 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260808 14:35:44.335490 23220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.330230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:42425 (local address 127.0.0.1:47712)
0808 14:35:44.330448 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.330479 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.330548 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.331168 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.331169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.331171 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:44.331236 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.331238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.332826 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.332827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.333909 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.333912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.335204 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.335205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.335282 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.335286 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.335350 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.335403 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":107,"threads_started":1}
I20260808 14:35:44.335506 23223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.330709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47712 (local address 127.20.81.1:42425)
0808 14:35:44.330966 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.330971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.330983 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:35:44.331031 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.331033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.331050 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.331328 (+ 278us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:44.331420 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.332727 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.333998 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.335072 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.335184 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.335248 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.335366 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.335403 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":103,"threads_started":1}
I20260808 14:35:44.335386 22979 tablet_service.cc:1467] Processing CreateTablet for tablet 41682497a5614e389525aa4a7ff90dc7 (DEFAULT_TABLE table=test-table [id=d8c21c9cebd643c485c97b99459255f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:44.335813 22979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41682497a5614e389525aa4a7ff90dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:44.335877 23221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.330443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56612 (local address 127.20.81.3:39509)
0808 14:35:44.330660 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.330666 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.330975 (+ 309us) server_negotiation.cc:407] Connection header received
0808 14:35:44.331094 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.331096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.331112 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.331163 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:44.331387 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.332716 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.334503 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.335411 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.335459 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.335510 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.335733 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.335779 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":95,"threads_started":1}
I20260808 14:35:44.336103 23217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.330229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39509 (local address 127.0.0.1:56612)
0808 14:35:44.330901 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.330911 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.331002 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.331254 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.331255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.331257 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:44.331300 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.331302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.333388 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.333389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.334407 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.334410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.335579 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.335580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.335642 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.335646 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.335995 (+ 349us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.336042 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":14,"thread_start_us":102,"threads_started":1}
I20260808 14:35:44.336640 22826 tablet_service.cc:1467] Processing CreateTablet for tablet 41682497a5614e389525aa4a7ff90dc7 (DEFAULT_TABLE table=test-table [id=d8c21c9cebd643c485c97b99459255f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:44.336798 23129 tablet_service.cc:1467] Processing CreateTablet for tablet 41682497a5614e389525aa4a7ff90dc7 (DEFAULT_TABLE table=test-table [id=d8c21c9cebd643c485c97b99459255f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:44.337040 22826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41682497a5614e389525aa4a7ff90dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:44.337167 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41682497a5614e389525aa4a7ff90dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:44.339815 23224 tablet_bootstrap.cc:492] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: Bootstrap starting.
I20260808 14:35:44.340452 23225 tablet_bootstrap.cc:492] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Bootstrap starting.
I20260808 14:35:44.340744 23227 tablet_bootstrap.cc:492] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Bootstrap starting.
I20260808 14:35:44.340790 23224 tablet_bootstrap.cc:654] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:44.341152 23224 log.cc:824] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:44.341440 23227 tablet_bootstrap.cc:654] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:44.341447 23225 tablet_bootstrap.cc:654] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:44.341806 23227 log.cc:824] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:44.341806 23225 log.cc:824] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:44.342124 23224 tablet_bootstrap.cc:492] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: No bootstrap required, opened a new log
I20260808 14:35:44.342206 23224 ts_tablet_manager.cc:1397] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:44.342499 23225 tablet_bootstrap.cc:492] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: No bootstrap required, opened a new log
I20260808 14:35:44.342549 23225 ts_tablet_manager.cc:1397] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:35:44.343855 23225 raft_consensus.cc:348] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.343832 23224 raft_consensus.cc:348] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.343983 23225 raft_consensus.cc:374] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:44.344008 23225 raft_consensus.cc:729] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ad1d3fc0ea48d79f8a61b14b6739c4, State: Initialized, Role: FOLLOWER
I20260808 14:35:44.344014 23224 raft_consensus.cc:374] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:44.344061 23224 raft_consensus.cc:729] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f02c33d5829488f85b65059b4058d99, State: Initialized, Role: FOLLOWER
I20260808 14:35:44.344138 23225 consensus_queue.cc:260] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.344183 23224 consensus_queue.cc:260] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.344420 23225 ts_tablet_manager.cc:1428] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:35:44.344515 23224 ts_tablet_manager.cc:1428] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:44.344595 23227 tablet_bootstrap.cc:492] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: No bootstrap required, opened a new log
I20260808 14:35:44.344604 23196 heartbeater.cc:503] Master 127.20.81.62:36725 was elected leader, sending a full tablet report...
I20260808 14:35:44.344604 23048 heartbeater.cc:503] Master 127.20.81.62:36725 was elected leader, sending a full tablet report...
I20260808 14:35:44.344659 23227 ts_tablet_manager.cc:1397] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 14:35:44.346750 23227 raft_consensus.cc:348] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.346876 23227 raft_consensus.cc:374] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:44.346897 23227 raft_consensus.cc:729] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce28a9407f74172965f7e90160ec1fb, State: Initialized, Role: FOLLOWER
I20260808 14:35:44.347023 23227 consensus_queue.cc:260] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.347295 23227 ts_tablet_manager.cc:1428] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:35:44.347349 22899 heartbeater.cc:503] Master 127.20.81.62:36725 was elected leader, sending a full tablet report...
W20260808 14:35:44.382236 23049 tablet.cc:2369] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:35:44.437577 23233 raft_consensus.cc:482] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:44.437709 23233 raft_consensus.cc:504] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.438153 23233 leader_election.cc:288] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3:39509)
I20260808 14:35:44.441344 23223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.438567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:45893 (local address 127.20.81.1:42425)
0808 14:35:44.438629 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.438632 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.438801 (+ 169us) server_negotiation.cc:407] Connection header received
0808 14:35:44.438836 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.438837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.438851 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.438912 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:44.439105 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.439599 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.440622 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.440968 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.441057 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.441067 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.441215 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.441261 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:35:44.441345 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.438483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39509 (local address 127.20.81.2:57639)
0808 14:35:44.438560 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.438572 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.438625 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.438815 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.438816 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.438819 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:44.438897 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.438899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.439617 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.439618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.440388 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.440390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.441073 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.441074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.441162 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.441165 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.441237 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.441278 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 14:35:44.441403 23221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.438567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:57639 (local address 127.20.81.3:39509)
0808 14:35:44.438644 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.438645 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.438654 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:44.438689 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.438690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.438703 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.438784 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:44.438981 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.439524 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.440610 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.440972 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.441049 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.441060 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.441263 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.441313 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:35:44.441349 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.438483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:42425 (local address 127.20.81.2:45893)
0808 14:35:44.438713 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.438724 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.438783 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.438926 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.438927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.438928 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:44.439026 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.439028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.439696 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.439697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.440394 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.440396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.441056 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.441057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.441139 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.441142 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.441186 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.441238 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":25,"thread_start_us":140,"threads_started":1}
I20260808 14:35:44.441756 23149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41682497a5614e389525aa4a7ff90dc7" candidate_uuid: "1f02c33d5829488f85b65059b4058d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" is_pre_election: true
I20260808 14:35:44.441921 23149 raft_consensus.cc:2454] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f02c33d5829488f85b65059b4058d99 in term 0.
I20260808 14:35:44.442050 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41682497a5614e389525aa4a7ff90dc7" candidate_uuid: "1f02c33d5829488f85b65059b4058d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb" is_pre_election: true
I20260808 14:35:44.442189 22929 leader_election.cc:302] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f02c33d5829488f85b65059b4058d99, 66ad1d3fc0ea48d79f8a61b14b6739c4; no voters:
I20260808 14:35:44.442227 22849 raft_consensus.cc:2454] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f02c33d5829488f85b65059b4058d99 in term 0.
I20260808 14:35:44.442322 23233 raft_consensus.cc:2781] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:44.442389 23233 raft_consensus.cc:482] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:44.442420 23233 raft_consensus.cc:3037] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:44.443419 23233 raft_consensus.cc:504] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.443570 23233 leader_election.cc:288] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3:39509)
I20260808 14:35:44.443749 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41682497a5614e389525aa4a7ff90dc7" candidate_uuid: "1f02c33d5829488f85b65059b4058d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb"
I20260808 14:35:44.443753 23149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41682497a5614e389525aa4a7ff90dc7" candidate_uuid: "1f02c33d5829488f85b65059b4058d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4"
I20260808 14:35:44.443828 22849 raft_consensus.cc:3037] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:44.443828 23149 raft_consensus.cc:3037] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:44.444736 22849 raft_consensus.cc:2454] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f02c33d5829488f85b65059b4058d99 in term 1.
I20260808 14:35:44.444736 23149 raft_consensus.cc:2454] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f02c33d5829488f85b65059b4058d99 in term 1.
I20260808 14:35:44.444958 22929 leader_election.cc:302] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f02c33d5829488f85b65059b4058d99, 66ad1d3fc0ea48d79f8a61b14b6739c4; no voters:
I20260808 14:35:44.445079 23233 raft_consensus.cc:2781] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:44.445266 23233 raft_consensus.cc:686] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 1 LEADER]: Becoming Leader. State: Replica: 1f02c33d5829488f85b65059b4058d99, State: Running, Role: LEADER
I20260808 14:35:44.445395 23233 consensus_queue.cc:237] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.446224 22679 catalog_manager.cc:5495] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f02c33d5829488f85b65059b4058d99 (127.20.81.2). New cstate: current_term: 1 leader_uuid: "1f02c33d5829488f85b65059b4058d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
W20260808 14:35:44.469331 22901 tablet.cc:2369] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 14:35:44 dist-test-slave-8n49 krb5kdc[22634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199743, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:44.504076 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.497311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44210 (local address 127.20.81.62:36725)
0808 14:35:44.497396 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.497399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.497553 (+ 154us) server_negotiation.cc:407] Connection header received
0808 14:35:44.497651 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.497652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.497669 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.497734 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:44.498214 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.498703 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.499400 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.499580 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.499668 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.501757 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:44.501758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:44.501758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:44.501765 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:44.503125 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.503467 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.503468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.503468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.503517 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:44.503680 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:44.503681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:44.503681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:44.503778 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:44.503828 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.503947 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.504010 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:35:44.504221 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.497249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:36725 (local address 127.0.0.1:44210)
0808 14:35:44.497477 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.497487 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.497574 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.497739 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.497740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.498063 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:44.498112 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.498115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.498791 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.498792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.499318 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.499319 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.499669 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.499670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.499725 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.500206 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:44.500223 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:44.501667 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:44.503200 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.503207 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.503209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.503395 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.503573 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:44.503574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:44.503574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:44.503627 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:44.503833 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:44.503839 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:44.503882 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.503933 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.504072 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":52,"thread_start_us":121,"threads_started":1}
I20260808 14:35:44.506328 22679 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:44210:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:35:44.506507 22679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:44.508016 22979 tablet_service.cc:1467] Processing CreateTablet for tablet 94073ea179ae40069ddb34ad655314d3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4c68a9a603c04e3f96566eb82f733a41]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:35:44.508047 23129 tablet_service.cc:1467] Processing CreateTablet for tablet 94073ea179ae40069ddb34ad655314d3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4c68a9a603c04e3f96566eb82f733a41]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:35:44.508209 22979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94073ea179ae40069ddb34ad655314d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:44.508216 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94073ea179ae40069ddb34ad655314d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:44.508730 22826 tablet_service.cc:1467] Processing CreateTablet for tablet 94073ea179ae40069ddb34ad655314d3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4c68a9a603c04e3f96566eb82f733a41]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:35:44.508971 22826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94073ea179ae40069ddb34ad655314d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:44.509593 23224 tablet_bootstrap.cc:492] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: Bootstrap starting.
I20260808 14:35:44.510025 23224 tablet_bootstrap.cc:654] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:44.510346 23227 tablet_bootstrap.cc:492] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: Bootstrap starting.
I20260808 14:35:44.510360 23225 tablet_bootstrap.cc:492] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Bootstrap starting.
I20260808 14:35:44.510762 23227 tablet_bootstrap.cc:654] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:44.510939 23225 tablet_bootstrap.cc:654] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:44.511399 23227 tablet_bootstrap.cc:492] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: No bootstrap required, opened a new log
I20260808 14:35:44.511435 23224 tablet_bootstrap.cc:492] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: No bootstrap required, opened a new log
I20260808 14:35:44.511457 23227 ts_tablet_manager.cc:1397] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:44.511473 23224 ts_tablet_manager.cc:1397] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:35:44.511624 23224 raft_consensus.cc:348] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.511632 23227 raft_consensus.cc:348] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.511710 23224 raft_consensus.cc:374] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:44.511710 23227 raft_consensus.cc:374] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:44.511689 23225 tablet_bootstrap.cc:492] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: No bootstrap required, opened a new log
I20260808 14:35:44.511735 23227 raft_consensus.cc:729] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce28a9407f74172965f7e90160ec1fb, State: Initialized, Role: FOLLOWER
I20260808 14:35:44.511735 23224 raft_consensus.cc:729] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f02c33d5829488f85b65059b4058d99, State: Initialized, Role: FOLLOWER
I20260808 14:35:44.511750 23225 ts_tablet_manager.cc:1397] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:44.511778 23224 consensus_queue.cc:260] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.511780 23227 consensus_queue.cc:260] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.511870 23224 ts_tablet_manager.cc:1428] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:44.511888 23227 ts_tablet_manager.cc:1428] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:35:44.511909 23225 raft_consensus.cc:348] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.511982 23225 raft_consensus.cc:374] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:44.512013 23225 raft_consensus.cc:729] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ad1d3fc0ea48d79f8a61b14b6739c4, State: Initialized, Role: FOLLOWER
I20260808 14:35:44.511996 23234 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.512073 23234 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:44.512066 23225 consensus_queue.cc:260] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.512176 23225 ts_tablet_manager.cc:1428] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:44.512195 23233 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.512284 23233 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:44.512446 23232 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.512579 23232 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:44.535315 23233 raft_consensus.cc:482] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:44.535391 23233 raft_consensus.cc:504] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.535531 23233 leader_election.cc:288] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3:39509)
I20260808 14:35:44.535727 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94073ea179ae40069ddb34ad655314d3" candidate_uuid: "1f02c33d5829488f85b65059b4058d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb" is_pre_election: true
I20260808 14:35:44.535758 23149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94073ea179ae40069ddb34ad655314d3" candidate_uuid: "1f02c33d5829488f85b65059b4058d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" is_pre_election: true
I20260808 14:35:44.535825 22849 raft_consensus.cc:2454] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f02c33d5829488f85b65059b4058d99 in term 0.
I20260808 14:35:44.535856 23149 raft_consensus.cc:2454] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f02c33d5829488f85b65059b4058d99 in term 0.
I20260808 14:35:44.535995 22927 leader_election.cc:302] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce28a9407f74172965f7e90160ec1fb, 1f02c33d5829488f85b65059b4058d99; no voters:
I20260808 14:35:44.536093 23233 raft_consensus.cc:2781] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:44.536146 23233 raft_consensus.cc:482] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:44.536160 23233 raft_consensus.cc:3037] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:44.536916 23233 raft_consensus.cc:504] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.537070 23233 leader_election.cc:288] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3:39509)
I20260808 14:35:44.537226 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94073ea179ae40069ddb34ad655314d3" candidate_uuid: "1f02c33d5829488f85b65059b4058d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb"
I20260808 14:35:44.537326 22849 raft_consensus.cc:3037] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:44.537261 23149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94073ea179ae40069ddb34ad655314d3" candidate_uuid: "1f02c33d5829488f85b65059b4058d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4"
I20260808 14:35:44.537364 23149 raft_consensus.cc:3037] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:44.537982 22849 raft_consensus.cc:2454] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f02c33d5829488f85b65059b4058d99 in term 1.
I20260808 14:35:44.538054 23149 raft_consensus.cc:2454] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f02c33d5829488f85b65059b4058d99 in term 1.
I20260808 14:35:44.538167 22927 leader_election.cc:302] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce28a9407f74172965f7e90160ec1fb, 1f02c33d5829488f85b65059b4058d99; no voters:
I20260808 14:35:44.538256 23233 raft_consensus.cc:2781] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:44.538347 23233 raft_consensus.cc:686] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [term 1 LEADER]: Becoming Leader. State: Replica: 1f02c33d5829488f85b65059b4058d99, State: Running, Role: LEADER
I20260808 14:35:44.538404 23233 consensus_queue.cc:237] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.538755 23236 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: TxnStatusTablet state changed. Reason: New leader 1f02c33d5829488f85b65059b4058d99. Latest consensus state: current_term: 1 leader_uuid: "1f02c33d5829488f85b65059b4058d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.538852 23236 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:35:44.539021 22679 catalog_manager.cc:5495] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f02c33d5829488f85b65059b4058d99 (127.20.81.2). New cstate: current_term: 1 leader_uuid: "1f02c33d5829488f85b65059b4058d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260808 14:35:44.539095 23249 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:35:44.539216 23249 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260808 14:35:44.544024 23197 tablet.cc:2369] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:35:44.550290 23222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.547346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52020 (local address 127.20.81.2:42681)
0808 14:35:44.547387 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.547391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.547474 (+ 83us) server_negotiation.cc:407] Connection header received
0808 14:35:44.547549 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.547549 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.547566 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.547624 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:44.547769 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.548381 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.549552 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.549737 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.549792 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.550004 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.550091 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.550146 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.550223 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.550239 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:35:44.550361 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.547310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:42681 (local address 127.0.0.1:52020)
0808 14:35:44.547400 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.547413 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.547468 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.547646 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.547647 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.547649 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:35:44.547704 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.547707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.548461 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.548462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.549472 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.549475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.549812 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.549813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.549884 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.549911 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.550153 (+ 242us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.550162 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.550221 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.550276 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 14:35:44.552196 22849 raft_consensus.cc:1261] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Refusing update from remote peer 1f02c33d5829488f85b65059b4058d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:44.552214 23149 raft_consensus.cc:1261] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Refusing update from remote peer 1f02c33d5829488f85b65059b4058d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:44.552538 23233 consensus_queue.cc:1035] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:44.552695 23236 consensus_queue.cc:1035] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:44.553824 23234 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: TxnStatusTablet state changed. Reason: New leader 1f02c33d5829488f85b65059b4058d99. Latest consensus state: current_term: 1 leader_uuid: "1f02c33d5829488f85b65059b4058d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.553918 23234 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:44.554793 23236 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1f02c33d5829488f85b65059b4058d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.554891 23236 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:35:44.554919 23232 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: TxnStatusTablet state changed. Reason: New leader 1f02c33d5829488f85b65059b4058d99. Latest consensus state: current_term: 1 leader_uuid: "1f02c33d5829488f85b65059b4058d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.555038 23232 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:44.555194 23252 mvcc.cc:205] Tried to move back new op lower bound from 7316274153683156992 to 7316274153629659136. Current Snapshot: MvccSnapshot[applied={T|T < 7316274153683156992}]
I20260808 14:35:44.555723 23234 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1f02c33d5829488f85b65059b4058d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.555810 23234 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 0ce28a9407f74172965f7e90160ec1fb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:44.556461 23259 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1f02c33d5829488f85b65059b4058d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.556645 23232 tablet_replica.cc:439] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1f02c33d5829488f85b65059b4058d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } } }
I20260808 14:35:44.556735 23232 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 66ad1d3fc0ea48d79f8a61b14b6739c4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:35:44.557011 23253 mvcc.cc:205] Tried to move back new op lower bound from 7316274153683156992 to 7316274153629659136. Current Snapshot: MvccSnapshot[applied={T|T < 7316274153683156992 or (T in {7316274153683156992})}]
I20260808 14:35:44.557035 23259 tablet_replica.cc:442] T 94073ea179ae40069ddb34ad655314d3 P 1f02c33d5829488f85b65059b4058d99: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:35:44.561415 23222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.558908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52032 (local address 127.20.81.2:42681)
0808 14:35:44.558946 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.558948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.559003 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:35:44.559094 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.559095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.559104 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.559147 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:44.559267 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.559722 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.560479 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.560781 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.560844 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.561034 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.561070 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.561116 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.561304 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.561326 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:35:44.567018 23222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.564281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:55195 (local address 127.20.81.2:42681)
0808 14:35:44.564320 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.564322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.564392 (+ 70us) server_negotiation.cc:407] Connection header received
0808 14:35:44.564465 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.564466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.564473 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.564516 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:44.564672 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.565092 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.566210 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.566432 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.566493 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.566720 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.566744 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.566782 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.566898 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.566914 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:35:44.567029 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.564221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:42681 (local address 127.20.81.2:55195)
0808 14:35:44.564345 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.564356 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.564407 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.564520 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.564520 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.564521 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:35:44.564603 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.564605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.565166 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.565167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.566130 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.566133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.566516 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.566518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.566586 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.566623 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.566803 (+ 180us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.566805 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.566853 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.566920 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 14:35:44.569088 23149 raft_consensus.cc:1261] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Refusing update from remote peer 1f02c33d5829488f85b65059b4058d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:44.569308 23259 consensus_queue.cc:1035] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:44.569393 22849 raft_consensus.cc:1261] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Refusing update from remote peer 1f02c33d5829488f85b65059b4058d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:44.569893 23259 consensus_queue.cc:1035] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:44.570850 23255 mvcc.cc:205] Tried to move back new op lower bound from 7316274153753432064 to 7316274153249050624. Current Snapshot: MvccSnapshot[applied={T|T < 7316274153753432064}]
I20260808 14:35:44.581220 22679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:44.581306 22679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:44.582012 22679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437: Sending DeleteTablet for 3 replicas of tablet 41682497a5614e389525aa4a7ff90dc7
I20260808 14:35:44.582324 23129 tablet_service.cc:1514] Processing DeleteTablet for tablet 41682497a5614e389525aa4a7ff90dc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:44 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:56612
I20260808 14:35:44.582325 22826 tablet_service.cc:1514] Processing DeleteTablet for tablet 41682497a5614e389525aa4a7ff90dc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:44 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:47712
I20260808 14:35:44.582633 22979 tablet_service.cc:1514] Processing DeleteTablet for tablet 41682497a5614e389525aa4a7ff90dc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:44 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:52014
I20260808 14:35:44.582659 23268 tablet_replica.cc:330] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: stopping tablet replica
I20260808 14:35:44.582762 23268 raft_consensus.cc:2229] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:44.582839 23268 raft_consensus.cc:2258] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:44.582952 23270 tablet_replica.cc:330] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: stopping tablet replica
I20260808 14:35:44.582882 22679 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:44.583032 22679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:44.583243 23270 raft_consensus.cc:2229] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:35:44.583300 23268 ts_tablet_manager.cc:1905] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:44.582571 23269 tablet_replica.cc:330] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: stopping tablet replica
I20260808 14:35:44.583421 23269 raft_consensus.cc:2229] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:44.583482 23269 pending_rounds.cc:62] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Trying to abort 1 pending ops.
I20260808 14:35:44.583506 23269 pending_rounds.cc:68] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Aborting op as it isn't in flight: id { term: 1 index: 5 } timestamp: 7316274153785610240 op_type: PARTICIPANT_OP participant_request { tablet_id: "41682497a5614e389525aa4a7ff90dc7" op { type: FINALIZE_COMMIT txn_id: 0 finalized_commit_timestamp: 7316274153776889856 } }
I20260808 14:35:44.583617 23269 raft_consensus.cc:2258] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:44.584045 23270 raft_consensus.cc:2258] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:44.584569 22979 tablet_service.cc:1467] Processing CreateTablet for tablet 5ffbd9be1f714b439a7158d6fe2eae3f (DEFAULT_TABLE table=test-table [id=557c8bdefd7b4308af3a6e760b179a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:44.584615 22826 tablet_service.cc:1467] Processing CreateTablet for tablet 5ffbd9be1f714b439a7158d6fe2eae3f (DEFAULT_TABLE table=test-table [id=557c8bdefd7b4308af3a6e760b179a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:44.584702 22826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ffbd9be1f714b439a7158d6fe2eae3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:44.584699 22979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ffbd9be1f714b439a7158d6fe2eae3f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260808 14:35:44.584721 23265 consensus_queue.cc:1159] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ce28a9407f74172965f7e90160ec1fb" status { last_received { term: 1 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 5 } }
I20260808 14:35:44.585381 23268 ts_tablet_manager.cc:1918] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:35:44.585448 23268 log.cc:1196] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/41682497a5614e389525aa4a7ff90dc7
I20260808 14:35:44.585702 23268 ts_tablet_manager.cc:1939] T 41682497a5614e389525aa4a7ff90dc7 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting consensus metadata
I20260808 14:35:44.586053 23227 tablet_bootstrap.cc:492] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: Bootstrap starting.
W20260808 14:35:44.586438 23269 mvcc.cc:119] aborting op with timestamp 7316274153776889856 in state 0; MVCC is closed
I20260808 14:35:44.586491 23227 tablet_bootstrap.cc:654] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:44.586526 23269 ts_tablet_manager.cc:1905] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:44.586822 23224 tablet_bootstrap.cc:492] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: Bootstrap starting.
I20260808 14:35:44.587255 23224 tablet_bootstrap.cc:654] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:44.587858 23224 tablet_bootstrap.cc:492] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: No bootstrap required, opened a new log
I20260808 14:35:44.587910 23224 ts_tablet_manager.cc:1397] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:44.588091 23224 raft_consensus.cc:348] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.588171 23224 raft_consensus.cc:374] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:44.588193 23224 raft_consensus.cc:729] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f02c33d5829488f85b65059b4058d99, State: Initialized, Role: FOLLOWER
I20260808 14:35:44.588176 23129 tablet_service.cc:1467] Processing CreateTablet for tablet 5ffbd9be1f714b439a7158d6fe2eae3f (DEFAULT_TABLE table=test-table [id=557c8bdefd7b4308af3a6e760b179a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:44.588187 22667 catalog_manager.cc:4841] TS 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3:39509): tablet 41682497a5614e389525aa4a7ff90dc7 (table test-table [id=d8c21c9cebd643c485c97b99459255f4]) successfully deleted
I20260808 14:35:44.588241 23224 consensus_queue.cc:260] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.588271 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ffbd9be1f714b439a7158d6fe2eae3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:44.588342 23224 ts_tablet_manager.cc:1428] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:44.587919 23270 ts_tablet_manager.cc:1905] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:44.588800 23227 tablet_bootstrap.cc:492] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: No bootstrap required, opened a new log
I20260808 14:35:44.588847 23227 ts_tablet_manager.cc:1397] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 14:35:44.588996 23227 raft_consensus.cc:348] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.589118 23227 raft_consensus.cc:374] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:44.589148 23227 raft_consensus.cc:729] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce28a9407f74172965f7e90160ec1fb, State: Initialized, Role: FOLLOWER
I20260808 14:35:44.589186 23227 consensus_queue.cc:260] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.589267 23227 ts_tablet_manager.cc:1428] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:44.589499 23225 tablet_bootstrap.cc:492] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: Bootstrap starting.
I20260808 14:35:44.589929 23225 tablet_bootstrap.cc:654] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:44.590487 23270 ts_tablet_manager.cc:1918] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:35:44.590560 23270 log.cc:1196] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/41682497a5614e389525aa4a7ff90dc7
I20260808 14:35:44.590591 23225 tablet_bootstrap.cc:492] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: No bootstrap required, opened a new log
I20260808 14:35:44.590631 23225 ts_tablet_manager.cc:1397] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:44.590796 23225 raft_consensus.cc:348] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.590874 23270 ts_tablet_manager.cc:1939] T 41682497a5614e389525aa4a7ff90dc7 P 1f02c33d5829488f85b65059b4058d99: Deleting consensus metadata
I20260808 14:35:44.590898 23225 raft_consensus.cc:374] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:44.590925 23225 raft_consensus.cc:729] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ad1d3fc0ea48d79f8a61b14b6739c4, State: Initialized, Role: FOLLOWER
I20260808 14:35:44.590979 23225 consensus_queue.cc:260] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.591087 23225 ts_tablet_manager.cc:1428] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:44.591647 22664 catalog_manager.cc:4841] TS 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681): tablet 41682497a5614e389525aa4a7ff90dc7 (table test-table [id=d8c21c9cebd643c485c97b99459255f4]) successfully deleted
I20260808 14:35:44.591982 23269 ts_tablet_manager.cc:1918] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:35:44.592056 23269 log.cc:1196] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/41682497a5614e389525aa4a7ff90dc7
I20260808 14:35:44.592267 23269 ts_tablet_manager.cc:1939] T 41682497a5614e389525aa4a7ff90dc7 P 0ce28a9407f74172965f7e90160ec1fb: Deleting consensus metadata
I20260808 14:35:44.592638 22666 catalog_manager.cc:4841] TS 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425): tablet 41682497a5614e389525aa4a7ff90dc7 (table test-table [id=d8c21c9cebd643c485c97b99459255f4]) successfully deleted
I20260808 14:35:44.596292 23232 raft_consensus.cc:482] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:44.596376 23232 raft_consensus.cc:504] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.596729 23232 leader_election.cc:288] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681)
I20260808 14:35:44.600095 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.596865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:42681 (local address 127.20.81.3:58133)
0808 14:35:44.596951 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.596963 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.597022 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.597366 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.597367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.597368 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:44.597422 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.597424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.598269 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.598270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.599003 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.599005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.599808 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.599809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.599897 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.599911 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.599975 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.600019 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 14:35:44.600109 23222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.597178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:58133 (local address 127.20.81.2:42681)
0808 14:35:44.597232 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.597235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.597242 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:35:44.597264 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.597265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.597273 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.597323 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:44.597481 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.598166 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.599104 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.599713 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.599789 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.599802 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.599996 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.600036 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:35:44.600365 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ffbd9be1f714b439a7158d6fe2eae3f" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f02c33d5829488f85b65059b4058d99" is_pre_election: true
I20260808 14:35:44.600495 23000 raft_consensus.cc:2454] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 0.
I20260808 14:35:44.600715 23075 leader_election.cc:302] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f02c33d5829488f85b65059b4058d99, 66ad1d3fc0ea48d79f8a61b14b6739c4; no voters:
I20260808 14:35:44.600831 23232 raft_consensus.cc:2781] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:44.600889 23232 raft_consensus.cc:482] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:44.600910 23232 raft_consensus.cc:3037] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:44.601536 23232 raft_consensus.cc:504] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.601693 23232 leader_election.cc:288] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681)
I20260808 14:35:44.601868 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ffbd9be1f714b439a7158d6fe2eae3f" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f02c33d5829488f85b65059b4058d99"
I20260808 14:35:44.601943 23000 raft_consensus.cc:3037] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:44.602766 23223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.597132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:56489 (local address 127.20.81.1:42425)
0808 14:35:44.597183 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.597185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.597193 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:35:44.597218 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.597219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.597228 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.597280 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:44.597426 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.598191 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.601797 (+ 3606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.602364 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.602413 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.602423 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.602647 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.602697 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:35:44.602788 23274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.596870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:42425 (local address 127.20.81.3:56489)
0808 14:35:44.597000 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.597010 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.597055 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.597285 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.597286 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.597288 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:44.597363 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.597365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.599117 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.599118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.600740 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.600743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.602485 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.602486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.602564 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.602569 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.602636 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.602677 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":19,"thread_start_us":55,"threads_started":1}
I20260808 14:35:44.602840 23000 raft_consensus.cc:2454] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 1.
I20260808 14:35:44.603163 23075 leader_election.cc:302] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f02c33d5829488f85b65059b4058d99, 66ad1d3fc0ea48d79f8a61b14b6739c4; no voters:
I20260808 14:35:44.603153 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ffbd9be1f714b439a7158d6fe2eae3f" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb" is_pre_election: true
I20260808 14:35:44.603154 22848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ffbd9be1f714b439a7158d6fe2eae3f" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb"
I20260808 14:35:44.603248 22849 raft_consensus.cc:2454] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 0.
I20260808 14:35:44.603323 23232 raft_consensus.cc:2781] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:44.603490 23232 raft_consensus.cc:686] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 LEADER]: Becoming Leader. State: Replica: 66ad1d3fc0ea48d79f8a61b14b6739c4, State: Running, Role: LEADER
I20260808 14:35:44.603561 23232 consensus_queue.cc:237] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:44.604293 22679 catalog_manager.cc:5495] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3). New cstate: current_term: 1 leader_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260808 14:35:44.613327 23221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.610922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56622 (local address 127.20.81.3:39509)
0808 14:35:44.610980 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.610982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.610991 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:44.611043 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.611044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.611063 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.611154 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:44.611276 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.611737 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.612480 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.612758 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.612830 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.612978 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.613091 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.613173 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.613225 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.613245 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:35:44.618445 23222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.615830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:53617 (local address 127.20.81.2:42681)
0808 14:35:44.615895 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.615897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.615906 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:44.615954 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.615955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.615967 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.616036 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:44.616146 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.616828 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.617687 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.617940 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.618013 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.618196 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.618229 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.618294 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.618356 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.618376 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:35:44.618486 23203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.615758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:42681 (local address 127.20.81.3:53617)
0808 14:35:44.615831 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.615848 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.615903 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.616025 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.616026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.616027 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:35:44.616089 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.616090 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.616914 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.616915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.617598 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.617601 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.618014 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.618014 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.618081 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.618106 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.618296 (+ 190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.618299 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.618352 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.618413 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 14:35:44.620702 22849 raft_consensus.cc:3037] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:44.620785 23000 raft_consensus.cc:1261] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Refusing update from remote peer 66ad1d3fc0ea48d79f8a61b14b6739c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:44.621052 23275 consensus_queue.cc:1035] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:44.621608 22849 raft_consensus.cc:1261] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Refusing update from remote peer 66ad1d3fc0ea48d79f8a61b14b6739c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:44.621805 23275 consensus_queue.cc:1035] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:44.629403 23221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.626520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:32879 (local address 127.20.81.3:39509)
0808 14:35:44.626578 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:44.626580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:44.626588 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:35:44.626609 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:44.626610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:44.626621 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:44.626676 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:44.626827 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.627603 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.628647 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.628946 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.629020 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.629169 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.629204 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.629255 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:44.629329 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 14:35:44.629355 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:35:44.629442 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:44.626450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39509 (local address 127.20.81.2:32879)
0808 14:35:44.626495 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:44.626505 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:44.626542 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:44.626700 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:44.626701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:44.626703 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:35:44.626748 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.626750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.627692 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.627693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.628504 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:44.628507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:44.629017 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:44.629018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:44.629075 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:44.629079 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:35:44.629263 (+ 184us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:35:44.629266 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:44.629324 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:35:44.629371 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 14:35:44.629729 23255 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:35:46.149685 22679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:46.149793 22679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:46.150684 22679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437: Sending DeleteTablet for 3 replicas of tablet 5ffbd9be1f714b439a7158d6fe2eae3f
I20260808 14:35:46.150969 22979 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ffbd9be1f714b439a7158d6fe2eae3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:46 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:52014
I20260808 14:35:46.150990 22826 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ffbd9be1f714b439a7158d6fe2eae3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:46 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:47712
I20260808 14:35:46.150990 23129 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ffbd9be1f714b439a7158d6fe2eae3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:46 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:56612
I20260808 14:35:46.151232 23310 tablet_replica.cc:330] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: stopping tablet replica
I20260808 14:35:46.151297 23310 raft_consensus.cc:2229] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:35:46.151293 23307 tablet_replica.cc:330] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: stopping tablet replica
I20260808 14:35:46.151468 23310 raft_consensus.cc:2258] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:46.151722 23310 ts_tablet_manager.cc:1905] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:46.151770 23308 tablet_replica.cc:330] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: stopping tablet replica
I20260808 14:35:46.151827 23308 raft_consensus.cc:2229] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:46.151861 23308 raft_consensus.cc:2258] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:46.151355 23307 raft_consensus.cc:2229] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:46.151949 23307 raft_consensus.cc:2258] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:46.152168 23308 ts_tablet_manager.cc:1905] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:46.153990 23310 ts_tablet_manager.cc:1918] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:35:46.154073 23310 log.cc:1196] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/5ffbd9be1f714b439a7158d6fe2eae3f
I20260808 14:35:46.154063 23308 ts_tablet_manager.cc:1918] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:35:46.154122 23308 log.cc:1196] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/5ffbd9be1f714b439a7158d6fe2eae3f
I20260808 14:35:46.154315 23310 ts_tablet_manager.cc:1939] T 5ffbd9be1f714b439a7158d6fe2eae3f P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting consensus metadata
I20260808 14:35:46.154353 23308 ts_tablet_manager.cc:1939] T 5ffbd9be1f714b439a7158d6fe2eae3f P 1f02c33d5829488f85b65059b4058d99: Deleting consensus metadata
I20260808 14:35:46.154665 22667 catalog_manager.cc:4841] TS 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3:39509): tablet 5ffbd9be1f714b439a7158d6fe2eae3f (table test-table [id=557c8bdefd7b4308af3a6e760b179a94]) successfully deleted
I20260808 14:35:46.154706 23307 ts_tablet_manager.cc:1905] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:46.155987 22664 catalog_manager.cc:4841] TS 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681): tablet 5ffbd9be1f714b439a7158d6fe2eae3f (table test-table [id=557c8bdefd7b4308af3a6e760b179a94]) successfully deleted
I20260808 14:35:46.156111 23307 ts_tablet_manager.cc:1918] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:35:46.156173 23307 log.cc:1196] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/5ffbd9be1f714b439a7158d6fe2eae3f
I20260808 14:35:46.156378 23307 ts_tablet_manager.cc:1939] T 5ffbd9be1f714b439a7158d6fe2eae3f P 0ce28a9407f74172965f7e90160ec1fb: Deleting consensus metadata
I20260808 14:35:46.156761 22666 catalog_manager.cc:4841] TS 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425): tablet 5ffbd9be1f714b439a7158d6fe2eae3f (table test-table [id=557c8bdefd7b4308af3a6e760b179a94]) successfully deleted
Aug 08 14:35:46 dist-test-slave-8n49 krb5kdc[22634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199746, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:35:46 dist-test-slave-8n49 krb5kdc[22634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199746, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:46.183117 23321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:46.171014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44212 (local address 127.20.81.62:36725)
0808 14:35:46.171176 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:46.171178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:46.171187 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:46.171241 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:46.171242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:46.171254 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:46.171314 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:46.171855 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:46.172372 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:46.173362 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:46.173567 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:46.173622 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:46.180643 (+ 7021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:46.180645 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:46.180645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:46.180654 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:46.182169 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:46.182470 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:46.182470 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:46.182471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:46.182524 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:46.182697 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:46.182697 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:46.182698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:46.182808 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:46.182884 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:46.182972 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 14:35:46.183037 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
I20260808 14:35:46.184630 22679 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:46.184813 22679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:46.186276 22979 tablet_service.cc:1467] Processing CreateTablet for tablet 248b3677a1eb49fb96d67ddc4b0369bf (DEFAULT_TABLE table=test-table [id=7b7c1b4789774d3783bfe7f83a79b744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:46.186300 23129 tablet_service.cc:1467] Processing CreateTablet for tablet 248b3677a1eb49fb96d67ddc4b0369bf (DEFAULT_TABLE table=test-table [id=7b7c1b4789774d3783bfe7f83a79b744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:46.186452 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 248b3677a1eb49fb96d67ddc4b0369bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:46.186445 22979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 248b3677a1eb49fb96d67ddc4b0369bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:46.187544 23322 tablet_bootstrap.cc:492] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: Bootstrap starting.
I20260808 14:35:46.187565 22826 tablet_service.cc:1467] Processing CreateTablet for tablet 248b3677a1eb49fb96d67ddc4b0369bf (DEFAULT_TABLE table=test-table [id=7b7c1b4789774d3783bfe7f83a79b744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:46.187685 22826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 248b3677a1eb49fb96d67ddc4b0369bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:46.187983 23322 tablet_bootstrap.cc:654] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:46.188642 23322 tablet_bootstrap.cc:492] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: No bootstrap required, opened a new log
I20260808 14:35:46.188696 23322 ts_tablet_manager.cc:1397] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:46.188671 23323 tablet_bootstrap.cc:492] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: Bootstrap starting.
I20260808 14:35:46.188812 23322 raft_consensus.cc:348] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.188899 23322 raft_consensus.cc:374] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:46.188921 23322 raft_consensus.cc:729] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ad1d3fc0ea48d79f8a61b14b6739c4, State: Initialized, Role: FOLLOWER
I20260808 14:35:46.188987 23322 consensus_queue.cc:260] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.189103 23323 tablet_bootstrap.cc:654] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:46.189209 23325 tablet_bootstrap.cc:492] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: Bootstrap starting.
I20260808 14:35:46.189229 23322 ts_tablet_manager.cc:1428] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:46.189824 23325 tablet_bootstrap.cc:654] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:46.190409 23323 tablet_bootstrap.cc:492] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: No bootstrap required, opened a new log
I20260808 14:35:46.190465 23323 ts_tablet_manager.cc:1397] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:35:46.190567 23323 raft_consensus.cc:348] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.190639 23323 raft_consensus.cc:374] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:46.190668 23323 raft_consensus.cc:729] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f02c33d5829488f85b65059b4058d99, State: Initialized, Role: FOLLOWER
I20260808 14:35:46.190758 23323 consensus_queue.cc:260] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.190918 23323 ts_tablet_manager.cc:1428] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:46.194087 23325 tablet_bootstrap.cc:492] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: No bootstrap required, opened a new log
I20260808 14:35:46.194156 23325 ts_tablet_manager.cc:1397] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 14:35:46.194324 23325 raft_consensus.cc:348] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.194401 23325 raft_consensus.cc:374] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:46.194425 23325 raft_consensus.cc:729] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce28a9407f74172965f7e90160ec1fb, State: Initialized, Role: FOLLOWER
I20260808 14:35:46.194494 23325 consensus_queue.cc:260] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.194689 23325 ts_tablet_manager.cc:1428] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:46.218400 23300 raft_consensus.cc:482] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:46.218510 23300 raft_consensus.cc:504] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.218722 23300 leader_election.cc:288] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681)
I20260808 14:35:46.218942 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "248b3677a1eb49fb96d67ddc4b0369bf" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb" is_pre_election: true
I20260808 14:35:46.218940 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "248b3677a1eb49fb96d67ddc4b0369bf" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f02c33d5829488f85b65059b4058d99" is_pre_election: true
I20260808 14:35:46.219045 22849 raft_consensus.cc:2454] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 0.
I20260808 14:35:46.219043 23000 raft_consensus.cc:2454] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 0.
I20260808 14:35:46.219234 23077 leader_election.cc:302] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0ce28a9407f74172965f7e90160ec1fb, 1f02c33d5829488f85b65059b4058d99, 66ad1d3fc0ea48d79f8a61b14b6739c4; no voters:
I20260808 14:35:46.219349 23300 raft_consensus.cc:2781] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:46.219398 23300 raft_consensus.cc:482] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:46.219414 23300 raft_consensus.cc:3037] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:46.220114 23300 raft_consensus.cc:504] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.220257 23300 leader_election.cc:288] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681)
I20260808 14:35:46.220418 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "248b3677a1eb49fb96d67ddc4b0369bf" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb"
I20260808 14:35:46.220438 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "248b3677a1eb49fb96d67ddc4b0369bf" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f02c33d5829488f85b65059b4058d99"
I20260808 14:35:46.220507 22849 raft_consensus.cc:3037] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:46.220507 23000 raft_consensus.cc:3037] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:46.221302 22849 raft_consensus.cc:2454] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 1.
I20260808 14:35:46.221303 23000 raft_consensus.cc:2454] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 1.
I20260808 14:35:46.221554 23075 leader_election.cc:302] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0ce28a9407f74172965f7e90160ec1fb, 1f02c33d5829488f85b65059b4058d99, 66ad1d3fc0ea48d79f8a61b14b6739c4; no voters:
I20260808 14:35:46.221665 23300 raft_consensus.cc:2781] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:46.221719 23300 raft_consensus.cc:686] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 LEADER]: Becoming Leader. State: Replica: 66ad1d3fc0ea48d79f8a61b14b6739c4, State: Running, Role: LEADER
I20260808 14:35:46.221768 23300 consensus_queue.cc:237] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.222383 22679 catalog_manager.cc:5495] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3). New cstate: current_term: 1 leader_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260808 14:35:46.238839 23332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:46.236658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56630 (local address 127.20.81.3:39509)
0808 14:35:46.236782 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:46.236784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:46.236792 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:35:46.236822 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:46.236823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:46.236833 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:46.236891 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:46.237018 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:46.237489 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:46.238205 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:46.238402 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:46.238454 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:46.238591 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:46.238625 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:46.238661 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:46.238714 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 14:35:46.238731 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":75,"threads_started":1}
I20260808 14:35:46.241204 23000 raft_consensus.cc:1261] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Refusing update from remote peer 66ad1d3fc0ea48d79f8a61b14b6739c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:46.241372 22849 raft_consensus.cc:1261] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Refusing update from remote peer 66ad1d3fc0ea48d79f8a61b14b6739c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:46.241449 23297 consensus_queue.cc:1035] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:46.241575 23300 consensus_queue.cc:1035] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:46.251535 22679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:46.251631 22679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:46.252305 22679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437: Sending DeleteTablet for 3 replicas of tablet 248b3677a1eb49fb96d67ddc4b0369bf
I20260808 14:35:46.252632 22826 tablet_service.cc:1514] Processing DeleteTablet for tablet 248b3677a1eb49fb96d67ddc4b0369bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:46 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:47712
I20260808 14:35:46.252671 23129 tablet_service.cc:1514] Processing DeleteTablet for tablet 248b3677a1eb49fb96d67ddc4b0369bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:46 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:56612
I20260808 14:35:46.252727 23307 tablet_replica.cc:330] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: stopping tablet replica
I20260808 14:35:46.252780 23307 raft_consensus.cc:2229] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:46.252816 23307 raft_consensus.cc:2258] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:46.252892 23310 tablet_replica.cc:330] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: stopping tablet replica
I20260808 14:35:46.252959 23310 raft_consensus.cc:2229] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:35:46.253017 23310 raft_consensus.cc:2258] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:46.253119 22979 tablet_service.cc:1514] Processing DeleteTablet for tablet 248b3677a1eb49fb96d67ddc4b0369bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:46 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:52014
I20260808 14:35:46.253226 23308 tablet_replica.cc:330] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: stopping tablet replica
I20260808 14:35:46.253284 23308 raft_consensus.cc:2229] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:46.253329 23308 raft_consensus.cc:2258] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:46.253324 23310 ts_tablet_manager.cc:1905] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:46.253579 23308 ts_tablet_manager.cc:1905] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:46.253580 23307 ts_tablet_manager.cc:1905] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:46.254838 23310 ts_tablet_manager.cc:1918] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:35:46.254932 23310 log.cc:1196] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/248b3677a1eb49fb96d67ddc4b0369bf
I20260808 14:35:46.255070 23308 ts_tablet_manager.cc:1918] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:35:46.255070 23307 ts_tablet_manager.cc:1918] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:35:46.255147 23308 log.cc:1196] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/248b3677a1eb49fb96d67ddc4b0369bf
I20260808 14:35:46.255147 23307 log.cc:1196] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/248b3677a1eb49fb96d67ddc4b0369bf
I20260808 14:35:46.255187 23310 ts_tablet_manager.cc:1939] T 248b3677a1eb49fb96d67ddc4b0369bf P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting consensus metadata
I20260808 14:35:46.255375 23307 ts_tablet_manager.cc:1939] T 248b3677a1eb49fb96d67ddc4b0369bf P 0ce28a9407f74172965f7e90160ec1fb: Deleting consensus metadata
I20260808 14:35:46.255375 23308 ts_tablet_manager.cc:1939] T 248b3677a1eb49fb96d67ddc4b0369bf P 1f02c33d5829488f85b65059b4058d99: Deleting consensus metadata
I20260808 14:35:46.255541 22667 catalog_manager.cc:4841] TS 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3:39509): tablet 248b3677a1eb49fb96d67ddc4b0369bf (table test-table [id=7b7c1b4789774d3783bfe7f83a79b744]) successfully deleted
I20260808 14:35:46.255541 22679 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:46.255722 22679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:46.255998 22664 catalog_manager.cc:4841] TS 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681): tablet 248b3677a1eb49fb96d67ddc4b0369bf (table test-table [id=7b7c1b4789774d3783bfe7f83a79b744]) successfully deleted
I20260808 14:35:46.256053 22666 catalog_manager.cc:4841] TS 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425): tablet 248b3677a1eb49fb96d67ddc4b0369bf (table test-table [id=7b7c1b4789774d3783bfe7f83a79b744]) successfully deleted
I20260808 14:35:46.257057 22979 tablet_service.cc:1467] Processing CreateTablet for tablet c5c841a73c46495da7f7a21956dc5c45 (DEFAULT_TABLE table=test-table [id=b6a4a978260542838f1790071fe1755c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:46.257057 23129 tablet_service.cc:1467] Processing CreateTablet for tablet c5c841a73c46495da7f7a21956dc5c45 (DEFAULT_TABLE table=test-table [id=b6a4a978260542838f1790071fe1755c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:46.257177 22979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c841a73c46495da7f7a21956dc5c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:46.257177 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c841a73c46495da7f7a21956dc5c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:46.258378 23322 tablet_bootstrap.cc:492] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Bootstrap starting.
I20260808 14:35:46.258385 23323 tablet_bootstrap.cc:492] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: Bootstrap starting.
I20260808 14:35:46.258687 23322 tablet_bootstrap.cc:654] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:46.258718 23323 tablet_bootstrap.cc:654] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:46.258960 22826 tablet_service.cc:1467] Processing CreateTablet for tablet c5c841a73c46495da7f7a21956dc5c45 (DEFAULT_TABLE table=test-table [id=b6a4a978260542838f1790071fe1755c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:46.259066 22826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c841a73c46495da7f7a21956dc5c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:46.259236 23322 tablet_bootstrap.cc:492] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: No bootstrap required, opened a new log
I20260808 14:35:46.259300 23322 ts_tablet_manager.cc:1397] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:46.259506 23323 tablet_bootstrap.cc:492] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: No bootstrap required, opened a new log
I20260808 14:35:46.259455 23322 raft_consensus.cc:348] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.259548 23322 raft_consensus.cc:374] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:46.259554 23323 ts_tablet_manager.cc:1397] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:46.259575 23322 raft_consensus.cc:729] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ad1d3fc0ea48d79f8a61b14b6739c4, State: Initialized, Role: FOLLOWER
I20260808 14:35:46.259627 23322 consensus_queue.cc:260] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.259667 23323 raft_consensus.cc:348] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.259716 23322 ts_tablet_manager.cc:1428] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:46.259729 23323 raft_consensus.cc:374] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:46.259752 23323 raft_consensus.cc:729] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f02c33d5829488f85b65059b4058d99, State: Initialized, Role: FOLLOWER
I20260808 14:35:46.259799 23323 consensus_queue.cc:260] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.259893 23323 ts_tablet_manager.cc:1428] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:46.260288 23325 tablet_bootstrap.cc:492] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb: Bootstrap starting.
I20260808 14:35:46.261092 23325 tablet_bootstrap.cc:654] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:46.261446 23297 raft_consensus.cc:482] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:46.261508 23297 raft_consensus.cc:504] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.261658 23297 leader_election.cc:288] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681)
I20260808 14:35:46.261742 23325 tablet_bootstrap.cc:492] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb: No bootstrap required, opened a new log
I20260808 14:35:46.261790 23325 ts_tablet_manager.cc:1397] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:35:46.261801 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c841a73c46495da7f7a21956dc5c45" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb" is_pre_election: true
I20260808 14:35:46.261854 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c841a73c46495da7f7a21956dc5c45" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f02c33d5829488f85b65059b4058d99" is_pre_election: true
I20260808 14:35:46.261917 23000 raft_consensus.cc:2454] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 0.
I20260808 14:35:46.261919 23325 raft_consensus.cc:348] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.261965 23325 raft_consensus.cc:374] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:46.261977 23325 raft_consensus.cc:729] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce28a9407f74172965f7e90160ec1fb, State: Initialized, Role: FOLLOWER
I20260808 14:35:46.262035 23325 consensus_queue.cc:260] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.262051 23075 leader_election.cc:302] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f02c33d5829488f85b65059b4058d99, 66ad1d3fc0ea48d79f8a61b14b6739c4; no voters:
I20260808 14:35:46.262130 23297 raft_consensus.cc:2781] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:46.262164 23325 ts_tablet_manager.cc:1428] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:46.262183 23297 raft_consensus.cc:482] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:46.262210 23297 raft_consensus.cc:3037] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:46.262245 22849 raft_consensus.cc:2454] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 0.
I20260808 14:35:46.262948 23297 raft_consensus.cc:504] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.263103 23297 leader_election.cc:288] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425), 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681)
I20260808 14:35:46.263257 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c841a73c46495da7f7a21956dc5c45" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f02c33d5829488f85b65059b4058d99"
I20260808 14:35:46.263247 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c841a73c46495da7f7a21956dc5c45" candidate_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce28a9407f74172965f7e90160ec1fb"
I20260808 14:35:46.263327 22849 raft_consensus.cc:3037] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:46.263348 23000 raft_consensus.cc:3037] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:46.263829 22849 raft_consensus.cc:2454] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 1.
I20260808 14:35:46.263948 23000 raft_consensus.cc:2454] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66ad1d3fc0ea48d79f8a61b14b6739c4 in term 1.
I20260808 14:35:46.263988 23077 leader_election.cc:302] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce28a9407f74172965f7e90160ec1fb, 66ad1d3fc0ea48d79f8a61b14b6739c4; no voters:
I20260808 14:35:46.264070 23297 raft_consensus.cc:2781] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:46.264119 23297 raft_consensus.cc:686] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 LEADER]: Becoming Leader. State: Replica: 66ad1d3fc0ea48d79f8a61b14b6739c4, State: Running, Role: LEADER
I20260808 14:35:46.264169 23297 consensus_queue.cc:237] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } }
I20260808 14:35:46.264688 22679 catalog_manager.cc:5495] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3). New cstate: current_term: 1 leader_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66ad1d3fc0ea48d79f8a61b14b6739c4" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260808 14:35:46.270365 22849 raft_consensus.cc:1261] T c5c841a73c46495da7f7a21956dc5c45 P 0ce28a9407f74172965f7e90160ec1fb [term 1 FOLLOWER]: Refusing update from remote peer 66ad1d3fc0ea48d79f8a61b14b6739c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:46.270413 23000 raft_consensus.cc:1261] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Refusing update from remote peer 66ad1d3fc0ea48d79f8a61b14b6739c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:46.270594 23297 consensus_queue.cc:1035] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f02c33d5829488f85b65059b4058d99" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:46.270726 23300 consensus_queue.cc:1035] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce28a9407f74172965f7e90160ec1fb" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:35:46.274837 23290 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:35:47.792642 22680 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:47.792763 22680 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:47.793622 22680 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cac30b278d14f13900b335de8b68437: Sending DeleteTablet for 3 replicas of tablet c5c841a73c46495da7f7a21956dc5c45
I20260808 14:35:47.793865 22979 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c841a73c46495da7f7a21956dc5c45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:47 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:52014
I20260808 14:35:47.793879 22826 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c841a73c46495da7f7a21956dc5c45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:47 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:47712
I20260808 14:35:47.793926 23129 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c841a73c46495da7f7a21956dc5c45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:47 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:56612
I20260808 14:35:47.794088 23367 tablet_replica.cc:330] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: stopping tablet replica
I20260808 14:35:47.794152 23367 raft_consensus.cc:2229] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:47.794196 23367 raft_consensus.cc:2258] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:47.794235 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 22756
I20260808 14:35:47.795680 23367 ts_tablet_manager.cc:1905] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:47.797562 23367 ts_tablet_manager.cc:1918] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:35:47.797643 23367 log.cc:1196] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/c5c841a73c46495da7f7a21956dc5c45
I20260808 14:35:47.797947 23367 ts_tablet_manager.cc:1939] T c5c841a73c46495da7f7a21956dc5c45 P 1f02c33d5829488f85b65059b4058d99: Deleting consensus metadata
I20260808 14:35:47.797935 23368 tablet_replica.cc:330] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: stopping tablet replica
I20260808 14:35:47.798002 23368 raft_consensus.cc:2229] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:35:47.798101 23368 raft_consensus.cc:2258] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:47.798280 22664 catalog_manager.cc:4841] TS 1f02c33d5829488f85b65059b4058d99 (127.20.81.2:42681): tablet c5c841a73c46495da7f7a21956dc5c45 (table test-table [id=b6a4a978260542838f1790071fe1755c]) successfully deleted
I20260808 14:35:47.798645 23368 ts_tablet_manager.cc:1905] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:47.800631 23368 ts_tablet_manager.cc:1918] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:35:47.800697 23368 log.cc:1196] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/c5c841a73c46495da7f7a21956dc5c45
I20260808 14:35:47.800958 23368 ts_tablet_manager.cc:1939] T c5c841a73c46495da7f7a21956dc5c45 P 66ad1d3fc0ea48d79f8a61b14b6739c4: Deleting consensus metadata
I20260808 14:35:47.801342 22667 catalog_manager.cc:4841] TS 66ad1d3fc0ea48d79f8a61b14b6739c4 (127.20.81.3:39509): tablet c5c841a73c46495da7f7a21956dc5c45 (table test-table [id=b6a4a978260542838f1790071fe1755c]) successfully deleted
W20260808 14:35:47.803339 22666 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:42425 (error 108)
I20260808 14:35:47.803974 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 22909
I20260808 14:35:47.804049 23372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:47.803789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:42425 (local address 127.0.0.1:36296)
0808 14:35:47.803942 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:47.803998 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:42425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
W20260808 14:35:47.805644 22666 catalog_manager.cc:4584] TS 0ce28a9407f74172965f7e90160ec1fb (127.20.81.1:42425): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c5c841a73c46495da7f7a21956dc5c45: Network error: Client connection negotiation failed: client connection to 127.20.81.1:42425: connect: Connection refused (error 111)
I20260808 14:35:47.812431 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 23058
I20260808 14:35:47.818717 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 22648
2026-08-08T14:35:47Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5365 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:47 dist-test-slave-8n49 krb5kdc[23375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:47 dist-test-slave-8n49 krb5kdc[23375](info): set up 2 sockets
Aug 08 14:35:47 dist-test-slave-8n49 krb5kdc[23375](info): commencing operation
krb5kdc: starting...
W20260808 14:35:48.900648 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:35:48 dist-test-slave-8n49 krb5kdc[23375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199748, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:35:49.032011 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33273
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:33273
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:49.129345 23390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:49.129562 23390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:49.129585 23390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:49.130746 23390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:49.130787 23390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:49.130802 23390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:49.130851 23390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:49.130877 23390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:49.132390 23390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:33273
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:49.132694 23390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:49.132937 23390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:49.137943 23398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:49.137974 23395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:49.138144 23390 server_base.cc:1034] running on GCE node
W20260808 14:35:49.137962 23396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:49.138468 23390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:49.138727 23390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:49.139871 23390 hybrid_clock.cc:648] HybridClock initialized: now 1786199749139835 us; error 49 us; skew 500 ppm
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199749, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:49.142438 23390 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:35:49.142946 23390 webserver.cc:460] Webserver started at http://127.20.81.62:44503/ using document root <none> and password file <none>
I20260808 14:35:49.143208 23390 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:49.143280 23390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:49.143440 23390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:49.144536 23390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "bc4cba1662444cd6a261c64b278d8b31"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "de0764ba0dd7cf08062ab3878e388006"
server_key_iv: "7001e82f533e0d05b8a00199ae6ea73e"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.144974 23390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "bc4cba1662444cd6a261c64b278d8b31"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "de0764ba0dd7cf08062ab3878e388006"
server_key_iv: "7001e82f533e0d05b8a00199ae6ea73e"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.146391 23390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:49.147156 23407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.147352 23390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:35:49.147457 23390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "bc4cba1662444cd6a261c64b278d8b31"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "de0764ba0dd7cf08062ab3878e388006"
server_key_iv: "7001e82f533e0d05b8a00199ae6ea73e"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.147547 23390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:49.183018 23390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:49.185165 23390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:49.185323 23390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:49.189471 23390 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:33273
I20260808 14:35:49.189535 23463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:33273 every 8 connection(s)
I20260808 14:35:49.189898 23390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:49.190845 23464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:49.193178 23464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31: Bootstrap starting.
I20260808 14:35:49.193755 23464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:49.194006 23464 log.cc:824] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:49.194698 23464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31: No bootstrap required, opened a new log
I20260808 14:35:49.196237 23464 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4cba1662444cd6a261c64b278d8b31" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33273 } }
I20260808 14:35:49.196377 23464 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:49.196401 23464 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc4cba1662444cd6a261c64b278d8b31, State: Initialized, Role: FOLLOWER
I20260808 14:35:49.196511 23464 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4cba1662444cd6a261c64b278d8b31" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33273 } }
I20260808 14:35:49.196590 23464 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:49.196611 23464 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:49.196638 23464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:49.197106 23464 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4cba1662444cd6a261c64b278d8b31" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33273 } }
I20260808 14:35:49.197192 23464 leader_election.cc:302] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc4cba1662444cd6a261c64b278d8b31; no voters:
I20260808 14:35:49.197348 23464 leader_election.cc:288] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:49.197381 23468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:49.197512 23468 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [term 1 LEADER]: Becoming Leader. State: Replica: bc4cba1662444cd6a261c64b278d8b31, State: Running, Role: LEADER
I20260808 14:35:49.197599 23468 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4cba1662444cd6a261c64b278d8b31" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33273 } }
I20260808 14:35:49.197640 23464 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:49.197932 23469 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc4cba1662444cd6a261c64b278d8b31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4cba1662444cd6a261c64b278d8b31" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33273 } } }
I20260808 14:35:49.198030 23469 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:49.198151 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 23390
I20260808 14:35:49.198179 23470 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc4cba1662444cd6a261c64b278d8b31. Latest consensus state: current_term: 1 leader_uuid: "bc4cba1662444cd6a261c64b278d8b31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4cba1662444cd6a261c64b278d8b31" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33273 } } }
I20260808 14:35:49.198263 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:49.198320 23475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:49.198354 23470 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:49.198483 20804 external_mini_cluster.cc:1428] Setting key f42d4e9027fde5222c0099ada412aa2c
I20260808 14:35:49.198855 23475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:49.200675 23475 catalog_manager.cc:1347] Generated new cluster ID: 9626ea37d2a64fe6b82e728779bcec5f
I20260808 14:35:49.200730 23475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199748, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:49.208945 23488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:49.199162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33438 (local address 127.20.81.62:33273)
0808 14:35:49.199379 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:49.199388 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:49.199620 (+ 232us) server_negotiation.cc:407] Connection header received
0808 14:35:49.199857 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:49.199867 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:49.199955 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:49.200066 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:49.200997 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.201912 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.202654 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.203139 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.203266 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:49.205619 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:49.205623 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:49.205624 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:49.205659 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:49.207318 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:49.207699 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:49.207703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:49.207703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:49.207810 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:49.208029 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:49.208030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:49.208031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:49.208275 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:49.208453 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:49.208574 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 14:35:49.208723 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":77,"threads_started":1}
I20260808 14:35:49.223042 23475 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:49.223608 23475 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:49.226431 23475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc4cba1662444cd6a261c64b278d8b31: Generated new TSK 0
I20260808 14:35:49.226636 23475 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:35:49.257336 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33273
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:49.343402 23494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:49.343648 23494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:49.343693 23494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:49.345139 23494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:49.345217 23494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:49.345270 23494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:35:49.346911 23494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:49.347213 23494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:49.347489 23494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:49.352837 23499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:49.352845 23502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:49.352845 23500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:49.353348 23494 server_base.cc:1034] running on GCE node
I20260808 14:35:49.353609 23494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:49.353879 23494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:49.355077 23494 hybrid_clock.cc:648] HybridClock initialized: now 1786199749355061 us; error 25 us; skew 500 ppm
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199749, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:49.357872 23494 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:35:49.358276 23494 webserver.cc:460] Webserver started at http://127.20.81.1:39759/ using document root <none> and password file <none>
I20260808 14:35:49.358464 23494 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:49.358503 23494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:49.358615 23494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:49.359697 23494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "cef61be9878c41659aa59ed2e0ae2758"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "2a6427553f2bf49e405baa8f6f9dffc0"
server_key_iv: "cbe5c5dd70b2e066fbdc0b3d207fac1b"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.360106 23494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "cef61be9878c41659aa59ed2e0ae2758"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "2a6427553f2bf49e405baa8f6f9dffc0"
server_key_iv: "cbe5c5dd70b2e066fbdc0b3d207fac1b"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.361651 23494 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:35:49.362394 23510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.362612 23494 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:49.362690 23494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "cef61be9878c41659aa59ed2e0ae2758"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "2a6427553f2bf49e405baa8f6f9dffc0"
server_key_iv: "cbe5c5dd70b2e066fbdc0b3d207fac1b"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.362746 23494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:49.395574 23494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:49.398217 23494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:49.398397 23494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:49.398682 23494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:49.399035 23494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:49.399072 23494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.399096 23494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:49.399107 23494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.405653 23494 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:35889
I20260808 14:35:49.405699 23631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:35889 every 8 connection(s)
I20260808 14:35:49.406039 23494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199749, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:49.413595 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 23494
I20260808 14:35:49.413686 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:49.413879 20804 external_mini_cluster.cc:1428] Setting key 004e0d7f1501deb46a7180a545b7d5ea
I20260808 14:35:49.415405 23488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:49.406808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:54791 (local address 127.20.81.62:33273)
0808 14:35:49.406861 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:49.406863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:49.407076 (+ 213us) server_negotiation.cc:407] Connection header received
0808 14:35:49.407576 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:49.407577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:49.407592 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:49.407656 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:49.408630 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.409134 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.410127 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.410316 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.410367 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:49.412473 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:49.412475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:49.412476 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:49.412483 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:49.413854 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:49.414376 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:49.414378 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:49.414378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:49.414446 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:49.414747 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:49.414748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:49.414748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:49.414866 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:49.414924 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:49.415265 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 14:35:49.415340 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:35:49.415715 23634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:49.406763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33273 (local address 127.20.81.1:54791)
0808 14:35:49.406944 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:49.406987 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:49.407491 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:49.407734 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:49.407737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:49.408308 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:49.408507 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:49.408512 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.409217 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.409218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:49.410047 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:49.410049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.410390 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.410391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:49.410492 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:49.410966 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:49.410975 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:49.412362 (+ 1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:49.413936 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:49.413946 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:49.413948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:49.414271 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:49.414533 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:49.414534 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:49.414535 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:49.414682 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:49.414938 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:49.414946 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:49.415116 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 14:35:49.415242 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 14:35:49.415426 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260808 14:35:49.416273 23632 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33273
I20260808 14:35:49.416399 23632 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:49.416658 23632 heartbeater.cc:511] Master 127.20.81.62:33273 requested a full tablet report, sending...
I20260808 14:35:49.417222 23426 ts_manager.cc:194] Registered new tserver with Master: cef61be9878c41659aa59ed2e0ae2758 (127.20.81.1:35889)
I20260808 14:35:49.418013 23426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:54791
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:35:49.444361 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33273
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:49.527258 23637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:49.527477 23637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:49.527503 23637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:49.528746 23637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:49.528796 23637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:49.528824 23637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:35:49.530287 23637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:49.530500 23637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:49.530699 23637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:49.536093 23642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:49.536093 23646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:49.536136 23643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:49.536655 23637 server_base.cc:1034] running on GCE node
I20260808 14:35:49.536914 23637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:49.537190 23637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:49.538369 23637 hybrid_clock.cc:648] HybridClock initialized: now 1786199749538359 us; error 35 us; skew 500 ppm
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199749, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:49.541227 23637 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:35:49.541720 23637 webserver.cc:460] Webserver started at http://127.20.81.2:35187/ using document root <none> and password file <none>
I20260808 14:35:49.541983 23637 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:49.542030 23637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:49.542197 23637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:49.543288 23637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "337d39900c4643f9986c9abea1a70b4d"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "770ac18f70cad870210c37de8e1721d3"
server_key_iv: "a38a23b4a69a69542a0920e5180a7e18"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.543654 23637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "337d39900c4643f9986c9abea1a70b4d"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "770ac18f70cad870210c37de8e1721d3"
server_key_iv: "a38a23b4a69a69542a0920e5180a7e18"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.545311 23637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:35:49.546217 23653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.546474 23637 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:49.546562 23637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "337d39900c4643f9986c9abea1a70b4d"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "770ac18f70cad870210c37de8e1721d3"
server_key_iv: "a38a23b4a69a69542a0920e5180a7e18"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.546669 23637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:49.558051 23637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:49.560436 23637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:49.560624 23637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:49.560882 23637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:49.561216 23637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:49.561251 23637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.561275 23637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:49.561286 23637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.568308 23637 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:39441
I20260808 14:35:49.568357 23775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:39441 every 8 connection(s)
I20260808 14:35:49.568725 23637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:35:49.570181 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 23637
I20260808 14:35:49.570317 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:49.570526 20804 external_mini_cluster.cc:1428] Setting key 5d20eba55ae0f25a0b261df4a43d0bf9
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199749, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:49.579879 23778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:49.569422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33273 (local address 127.20.81.2:50867)
0808 14:35:49.569606 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:49.569645 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:49.570144 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:49.570543 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:49.570547 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:49.571324 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:49.571546 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:49.571551 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.572598 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.572599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:49.573445 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:49.573447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.573967 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.573968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:49.574086 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:49.574644 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:49.574653 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:49.576251 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:49.578329 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:49.578336 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:49.578338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:49.578584 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:49.578854 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:49.578855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:49.578855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:49.578972 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:49.579335 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:49.579342 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:49.579488 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 14:35:49.579581 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:35:49.579707 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":116,"threads_started":1}
I20260808 14:35:49.579870 23488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:49.569468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:50867 (local address 127.20.81.62:33273)
0808 14:35:49.569563 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:49.569566 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:49.569740 (+ 174us) server_negotiation.cc:407] Connection header received
0808 14:35:49.570253 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:49.570254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:49.570271 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:49.570349 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:49.571657 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.572431 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.573538 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.573858 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.573943 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:49.576353 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:49.576355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:49.576356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:49.576365 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:49.578224 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:49.578678 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:49.578679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:49.578680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:49.578755 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:49.579062 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:49.579064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:49.579065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:49.579232 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:49.579322 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:49.579642 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 14:35:49.579748 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:35:49.580476 23776 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33273
I20260808 14:35:49.580626 23776 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:35:49.580865 23776 heartbeater.cc:511] Master 127.20.81.62:33273 requested a full tablet report, sending...
I20260808 14:35:49.581276 23426 ts_manager.cc:194] Registered new tserver with Master: 337d39900c4643f9986c9abea1a70b4d (127.20.81.2:39441)
I20260808 14:35:49.581683 23426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:50867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:35:49.599978 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33273
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:49.685086 23781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:49.685294 23781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:49.685318 23781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:49.686429 23781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:49.686465 23781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:49.686501 23781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:35:49.687974 23781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:49.688235 23781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:49.688489 23781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:49.693517 23786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:49.693589 23787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:49.693720 23781 server_base.cc:1034] running on GCE node
W20260808 14:35:49.693553 23789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:49.694036 23781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:49.694252 23781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:49.695400 23781 hybrid_clock.cc:648] HybridClock initialized: now 1786199749695372 us; error 43 us; skew 500 ppm
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199749, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:49.698063 23781 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:35:49.698652 23781 webserver.cc:460] Webserver started at http://127.20.81.3:35177/ using document root <none> and password file <none>
I20260808 14:35:49.698912 23781 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:49.698990 23781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:49.699138 23781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:49.700203 23781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "64c0366cc6744867801b041db8cb0d7f"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "b11ccf6b42f3b0854f6badc8401b8233"
server_key_iv: "71628ab3b7cfca76c3d69c940300d8d4"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.700626 23781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "64c0366cc6744867801b041db8cb0d7f"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "b11ccf6b42f3b0854f6badc8401b8233"
server_key_iv: "71628ab3b7cfca76c3d69c940300d8d4"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.701960 23781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:49.702713 23796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.702896 23781 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:35:49.702994 23781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "64c0366cc6744867801b041db8cb0d7f"
format_stamp: "Formatted at 2026-08-08 14:35:49 on dist-test-slave-8n49"
server_key: "b11ccf6b42f3b0854f6badc8401b8233"
server_key_iv: "71628ab3b7cfca76c3d69c940300d8d4"
server_key_version: "encryptionkey@0"
I20260808 14:35:49.703081 23781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:49.721946 23781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:49.724206 23781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:49.724375 23781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:49.724684 23781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:49.725018 23781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:49.725080 23781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.725121 23781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:49.725148 23781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:49.731256 23781 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:37163
I20260808 14:35:49.731329 23921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:37163 every 8 connection(s)
I20260808 14:35:49.731629 23781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:49.735711 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 23781
I20260808 14:35:49.735791 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:49.736002 20804 external_mini_cluster.cc:1428] Setting key 9b36e54168d99aaf654187e26a31a819
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199749, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:49.741581 23488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:49.732371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:40557 (local address 127.20.81.62:33273)
0808 14:35:49.732452 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:49.732454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:49.732637 (+ 183us) server_negotiation.cc:407] Connection header received
0808 14:35:49.733162 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:49.733164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:49.733176 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:49.733237 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:49.734215 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.734821 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.735917 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.736161 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.736239 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:49.738715 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:49.738717 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:49.738717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:49.738725 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:49.740037 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:49.740498 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:49.740500 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:49.740500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:49.740613 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:49.740890 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:49.740891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:49.740891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:49.741021 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:49.741102 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:49.741404 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 14:35:49.741487 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:35:49.741791 23924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:49.732322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33273 (local address 127.20.81.3:40557)
0808 14:35:49.732496 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:49.732540 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:49.733066 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:49.733319 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:49.733323 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:49.733902 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:49.734111 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:49.734116 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.734922 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.734923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:49.735830 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:49.735833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:49.736304 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:49.736306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:49.736527 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:49.737161 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:49.737170 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:49.738608 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:49.740154 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:49.740161 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:49.740163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:49.740405 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:49.740691 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:49.740692 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:49.740693 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:49.740811 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:49.741106 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:49.741113 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:49.741260 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 14:35:49.741368 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:35:49.741543 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":103,"threads_started":1}
I20260808 14:35:49.742329 23922 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33273
I20260808 14:35:49.742426 23922 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:49.742587 23922 heartbeater.cc:511] Master 127.20.81.62:33273 requested a full tablet report, sending...
I20260808 14:35:49.742969 23426 ts_manager.cc:194] Registered new tserver with Master: 64c0366cc6744867801b041db8cb0d7f (127.20.81.3:37163)
I20260808 14:35:49.743309 23426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:40557
I20260808 14:35:49.747859 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:35:49.762112 23488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:35:49.760998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33448 (local address 127.20.81.62:33273)
0808 14:35:49.761082 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:49.761085 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:49.761210 (+ 125us) server_negotiation.cc:407] Connection header received
0808 14:35:49.761246 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:49.761247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:49.761258 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:49.761316 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:49.761991 (+ 675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33448: BlockingRecv error: recv got EOF from 127.0.0.1:33448 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:35:49.762895 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 23494
I20260808 14:35:49.769104 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 23637
I20260808 14:35:49.776780 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 23781
I20260808 14:35:49.784045 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 23390
2026-08-08T14:35:49Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1963 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23935](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23935](info): set up 2 sockets
Aug 08 14:35:49 dist-test-slave-8n49 krb5kdc[23935](info): commencing operation
krb5kdc: starting...
W20260808 14:35:50.953394 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260808 14:35:51.193328 20804 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.240s user 0.001s sys 0.001s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260808 14:35:51.421770 20804 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.228s user 0.001s sys 0.001s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260808 14:35:51.571869 20804 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.150s user 0.001s sys 0.001s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/test-user.keytab.
W20260808 14:35:51.984480 20804 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.412s user 0.000s sys 0.002s
Aug 08 14:35:51 dist-test-slave-8n49 krb5kdc[23935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:35:52.032207 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44371
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:44371
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:52.115846 23948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:52.116041 23948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:52.116063 23948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:52.117259 23948 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:52.117300 23948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:52.117313 23948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:52.117373 23948 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:52.117403 23948 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:52.118940 23948 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:44371
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:52.119207 23948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:52.119436 23948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:52.124289 23955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:52.124279 23957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:52.124511 23948 server_base.cc:1034] running on GCE node
W20260808 14:35:52.124544 23954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:52.124815 23948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:52.125103 23948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:52.126271 23948 hybrid_clock.cc:648] HybridClock initialized: now 1786199752126265 us; error 50 us; skew 500 ppm
Aug 08 14:35:52 dist-test-slave-8n49 krb5kdc[23935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199752, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:52.131697 23948 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:35:52.132167 23948 webserver.cc:460] Webserver started at http://127.20.81.62:38003/ using document root <none> and password file <none>
I20260808 14:35:52.132411 23948 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:52.132488 23948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:52.132661 23948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:52.133764 23948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "181ba788a70042728e2dc39bdbf8fde7"
format_stamp: "Formatted at 2026-08-08 14:35:52 on dist-test-slave-8n49"
server_key: "73e69f8e9f172a161dbda1e7adc1e8b0"
server_key_iv: "11dcba1ac14944622febf07bc3f14533"
server_key_version: "encryptionkey@0"
I20260808 14:35:52.134136 23948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "181ba788a70042728e2dc39bdbf8fde7"
format_stamp: "Formatted at 2026-08-08 14:35:52 on dist-test-slave-8n49"
server_key: "73e69f8e9f172a161dbda1e7adc1e8b0"
server_key_iv: "11dcba1ac14944622febf07bc3f14533"
server_key_version: "encryptionkey@0"
I20260808 14:35:52.135493 23948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:35:52.136196 23965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:52.136376 23948 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:52.136499 23948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "181ba788a70042728e2dc39bdbf8fde7"
format_stamp: "Formatted at 2026-08-08 14:35:52 on dist-test-slave-8n49"
server_key: "73e69f8e9f172a161dbda1e7adc1e8b0"
server_key_iv: "11dcba1ac14944622febf07bc3f14533"
server_key_version: "encryptionkey@0"
I20260808 14:35:52.136598 23948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:52.171618 23948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:52.173982 23948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:52.174151 23948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:52.178406 23948 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:44371
I20260808 14:35:52.178444 24020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:44371 every 8 connection(s)
I20260808 14:35:52.179069 23948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:52.179762 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:52.182209 24021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7: Bootstrap starting.
I20260808 14:35:52.182771 24021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:52.183028 24021 log.cc:824] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:52.183665 24021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7: No bootstrap required, opened a new log
I20260808 14:35:52.185343 24021 raft_consensus.cc:348] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "181ba788a70042728e2dc39bdbf8fde7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44371 } }
I20260808 14:35:52.185483 24021 raft_consensus.cc:374] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:52.185505 24021 raft_consensus.cc:729] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181ba788a70042728e2dc39bdbf8fde7, State: Initialized, Role: FOLLOWER
I20260808 14:35:52.185606 24021 consensus_queue.cc:260] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "181ba788a70042728e2dc39bdbf8fde7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44371 } }
I20260808 14:35:52.185658 24021 raft_consensus.cc:388] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:52.185678 24021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:52.185750 24021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:52.186646 24021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "181ba788a70042728e2dc39bdbf8fde7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44371 } }
I20260808 14:35:52.186764 24021 leader_election.cc:302] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 181ba788a70042728e2dc39bdbf8fde7; no voters:
I20260808 14:35:52.186950 24021 leader_election.cc:288] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:52.186993 24024 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:52.187183 24024 raft_consensus.cc:686] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [term 1 LEADER]: Becoming Leader. State: Replica: 181ba788a70042728e2dc39bdbf8fde7, State: Running, Role: LEADER
I20260808 14:35:52.187232 24021 sys_catalog.cc:564] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:52.187351 24024 consensus_queue.cc:237] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "181ba788a70042728e2dc39bdbf8fde7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44371 } }
I20260808 14:35:52.187755 24025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "181ba788a70042728e2dc39bdbf8fde7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "181ba788a70042728e2dc39bdbf8fde7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44371 } } }
I20260808 14:35:52.187758 24026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 181ba788a70042728e2dc39bdbf8fde7. Latest consensus state: current_term: 1 leader_uuid: "181ba788a70042728e2dc39bdbf8fde7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "181ba788a70042728e2dc39bdbf8fde7" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44371 } } }
I20260808 14:35:52.187879 24025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:52.187887 24026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:52.188086 24033 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:52.188218 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 23948
I20260808 14:35:52.188336 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:52.188581 20804 external_mini_cluster.cc:1428] Setting key 59ccb5a4b53d003c37978bcd87ebc29a
I20260808 14:35:52.188733 24033 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:52.190390 24033 catalog_manager.cc:1347] Generated new cluster ID: 91fcb103d70d4bd1ae92d61319479241
I20260808 14:35:52.190454 24033 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:35:52 dist-test-slave-8n49 krb5kdc[23935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:52.198582 24046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:52.189188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54082 (local address 127.20.81.62:44371)
0808 14:35:52.189344 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:52.189354 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:52.189469 (+ 115us) server_negotiation.cc:407] Connection header received
0808 14:35:52.189659 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:52.189666 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:52.189734 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:52.189876 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:52.190632 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:52.191535 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:52.192319 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:52.192872 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:52.192990 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:52.195294 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:52.195298 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:52.195299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:52.195312 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:52.197027 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:52.197398 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:52.197402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:52.197402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:52.197501 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:52.197725 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:52.197726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:52.197726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:52.197966 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:52.198150 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:52.198220 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 14:35:52.198366 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":69,"threads_started":1}
I20260808 14:35:52.199597 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:35:52.199716 24033 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:52.200435 24033 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:52.204481 24033 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 181ba788a70042728e2dc39bdbf8fde7: Generated new TSK 0
I20260808 14:35:52.204697 24033 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:35:52.216261 24046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:52.212695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54096 (local address 127.20.81.62:44371)
0808 14:35:52.212738 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:52.212740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:52.212897 (+ 157us) server_negotiation.cc:407] Connection header received
0808 14:35:52.212976 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:52.212977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:52.212989 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:52.213050 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:52.213443 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:52.213972 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:52.214732 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:52.214969 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:52.215051 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:52.215774 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:52.215776 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:52.215776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:52.215977 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:52.215993 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:52.215999 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:52.216066 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:52.216141 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 14:35:52.216172 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:35:52.218845 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 23948
2026-08-08T14:35:52Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2434 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:52 dist-test-slave-8n49 krb5kdc[24057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:52 dist-test-slave-8n49 krb5kdc[24057](info): set up 2 sockets
Aug 08 14:35:52 dist-test-slave-8n49 krb5kdc[24057](info): commencing operation
krb5kdc: starting...
W20260808 14:35:53.296164 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:35:53 dist-test-slave-8n49 krb5kdc[24057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:35:53.419350 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44833
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:39629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:44833
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:53.502570 24072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:53.502813 24072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:53.502852 24072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:53.504012 24072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:53.504083 24072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:53.504110 24072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:53.504149 24072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:53.504176 24072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:53.505702 24072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:39629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:44833
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:53.505992 24072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:53.506232 24072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:53.511252 24077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:53.511222 24081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:53.511235 24079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:53.511382 24072 server_base.cc:1034] running on GCE node
I20260808 14:35:53.511703 24072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:53.512051 24072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:53.513240 24072 hybrid_clock.cc:648] HybridClock initialized: now 1786199753513223 us; error 27 us; skew 500 ppm
Aug 08 14:35:53 dist-test-slave-8n49 krb5kdc[24057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199753, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:53.516042 24072 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:35:53.516530 24072 webserver.cc:460] Webserver started at http://127.20.81.62:41731/ using document root <none> and password file <none>
I20260808 14:35:53.516857 24072 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:53.516911 24072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:53.517102 24072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:53.518252 24072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "82223f050f264a0daef5a6e788e68874"
format_stamp: "Formatted at 2026-08-08 14:35:53 on dist-test-slave-8n49"
server_key: "c9ea54e68554e18095a019cb8de6214c"
server_key_iv: "16d45a65c03bcafd260d2447a6538495"
server_key_version: "encryptionkey@0"
I20260808 14:35:53.518664 24072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "82223f050f264a0daef5a6e788e68874"
format_stamp: "Formatted at 2026-08-08 14:35:53 on dist-test-slave-8n49"
server_key: "c9ea54e68554e18095a019cb8de6214c"
server_key_iv: "16d45a65c03bcafd260d2447a6538495"
server_key_version: "encryptionkey@0"
I20260808 14:35:53.520129 24072 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:35:53.521027 24088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:53.521226 24072 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:35:53.521332 24072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "82223f050f264a0daef5a6e788e68874"
format_stamp: "Formatted at 2026-08-08 14:35:53 on dist-test-slave-8n49"
server_key: "c9ea54e68554e18095a019cb8de6214c"
server_key_iv: "16d45a65c03bcafd260d2447a6538495"
server_key_version: "encryptionkey@0"
I20260808 14:35:53.521435 24072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:53.534431 24072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:53.537046 24072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:53.537228 24072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:53.541790 24072 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:44833
I20260808 14:35:53.541821 24145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:44833 every 8 connection(s)
I20260808 14:35:53.542210 24072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:53.543448 24146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:53.544508 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 24072
I20260808 14:35:53.544660 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:53.544864 20804 external_mini_cluster.cc:1428] Setting key e3c07eccaf7ecbaabf8a33e1a7cc0b66
I20260808 14:35:53.546460 24146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874: Bootstrap starting.
I20260808 14:35:53.547138 24146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:53.547461 24146 log.cc:824] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:53.548231 24146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874: No bootstrap required, opened a new log
I20260808 14:35:53.550475 24146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82223f050f264a0daef5a6e788e68874" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44833 } }
I20260808 14:35:53.550622 24146 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:53.550644 24146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82223f050f264a0daef5a6e788e68874, State: Initialized, Role: FOLLOWER
I20260808 14:35:53.550787 24146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82223f050f264a0daef5a6e788e68874" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44833 } }
I20260808 14:35:53.550866 24146 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:53.550889 24146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:53.550961 24146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:53.551548 24146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82223f050f264a0daef5a6e788e68874" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44833 } }
I20260808 14:35:53.551664 24146 leader_election.cc:302] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82223f050f264a0daef5a6e788e68874; no voters:
I20260808 14:35:53.551848 24146 leader_election.cc:288] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:53.551898 24151 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:53.552052 24151 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [term 1 LEADER]: Becoming Leader. State: Replica: 82223f050f264a0daef5a6e788e68874, State: Running, Role: LEADER
I20260808 14:35:53.552121 24146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:53.552188 24151 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82223f050f264a0daef5a6e788e68874" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44833 } }
Aug 08 14:35:53 dist-test-slave-8n49 krb5kdc[24057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:53.552611 24151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82223f050f264a0daef5a6e788e68874. Latest consensus state: current_term: 1 leader_uuid: "82223f050f264a0daef5a6e788e68874" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82223f050f264a0daef5a6e788e68874" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44833 } } }
I20260808 14:35:53.552675 24151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:53.553164 24153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82223f050f264a0daef5a6e788e68874" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82223f050f264a0daef5a6e788e68874" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44833 } } }
I20260808 14:35:53.553241 24153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:53.553479 24157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:53.554068 24157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:53.555807 24157 catalog_manager.cc:1347] Generated new cluster ID: acb095cb0b854a01a18712405202cdb9
I20260808 14:35:53.555900 24157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:35:53.556998 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:53.545467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49610 (local address 127.20.81.62:44833)
0808 14:35:53.545683 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:53.545693 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:53.545728 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:35:53.546253 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:53.546262 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:53.546324 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:53.546478 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:53.547162 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.548516 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.549307 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.549963 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.550125 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:53.553060 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:53.553065 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:53.553065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:53.553080 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:53.555275 (+ 2195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:53.555690 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:53.555693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:53.555694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:53.555802 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:53.556052 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:53.556053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:53.556054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:53.556306 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:53.556455 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:53.556678 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 14:35:53.556830 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":97,"threads_started":1}
I20260808 14:35:53.564791 24157 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:53.565511 24157 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:53.569725 24157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82223f050f264a0daef5a6e788e68874: Generated new TSK 0
I20260808 14:35:53.569903 24157 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:35:53.603009 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44833
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:39629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:53.703540 24173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:53.703783 24173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:53.703820 24173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:53.704998 24173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:53.705065 24173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:53.705112 24173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:35:53.706579 24173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:39629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44833
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:53.706852 24173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:53.707083 24173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:53.712229 24181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:53.712198 24178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:53.712198 24179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:53.712599 24173 server_base.cc:1034] running on GCE node
I20260808 14:35:53.712807 24173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:53.713043 24173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:53.714222 24173 hybrid_clock.cc:648] HybridClock initialized: now 1786199753714185 us; error 50 us; skew 500 ppm
Aug 08 14:35:53 dist-test-slave-8n49 krb5kdc[24057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199753, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:53.716841 24173 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:35:53.717303 24173 webserver.cc:460] Webserver started at http://127.20.81.1:37875/ using document root <none> and password file <none>
I20260808 14:35:53.717561 24173 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:53.717609 24173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:53.717777 24173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:53.718935 24173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "cb0e93034f7f4858bb97a01d935fc7b4"
format_stamp: "Formatted at 2026-08-08 14:35:53 on dist-test-slave-8n49"
server_key: "9c5fd223da04db88f2d4d5296d51e4ff"
server_key_iv: "8b122fae5ac6242730d266fe00a68693"
server_key_version: "encryptionkey@0"
I20260808 14:35:53.719305 24173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "cb0e93034f7f4858bb97a01d935fc7b4"
format_stamp: "Formatted at 2026-08-08 14:35:53 on dist-test-slave-8n49"
server_key: "9c5fd223da04db88f2d4d5296d51e4ff"
server_key_iv: "8b122fae5ac6242730d266fe00a68693"
server_key_version: "encryptionkey@0"
I20260808 14:35:53.720713 24173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:35:53.721534 24188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:53.721731 24173 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:35:53.721837 24173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "cb0e93034f7f4858bb97a01d935fc7b4"
format_stamp: "Formatted at 2026-08-08 14:35:53 on dist-test-slave-8n49"
server_key: "9c5fd223da04db88f2d4d5296d51e4ff"
server_key_iv: "8b122fae5ac6242730d266fe00a68693"
server_key_version: "encryptionkey@0"
I20260808 14:35:53.721915 24173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:53.734699 24173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:53.736701 24173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:53.736860 24173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:53.737092 24173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:53.737414 24173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:53.737469 24173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:53.737514 24173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:53.737546 24173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:53.743606 24173 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:36629
I20260808 14:35:53.743651 24312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:36629 every 8 connection(s)
I20260808 14:35:53.744002 24173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:35:53.749337 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 24173
I20260808 14:35:53.749461 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:53.749672 20804 external_mini_cluster.cc:1428] Setting key b675f809f02ef1a2d8feff03477bced5
Aug 08 14:35:53 dist-test-slave-8n49 krb5kdc[24057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199753, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:53.754196 24315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:53.744747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44833 (local address 127.20.81.1:34727)
0808 14:35:53.744934 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:53.744977 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:53.745464 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:53.745669 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:53.745673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:53.746264 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:53.746460 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:53.746465 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.747213 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.747213 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:53.748014 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:53.748022 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.748400 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.748402 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:53.748521 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:53.749134 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:53.749144 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:53.750760 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:53.752514 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:53.752522 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:53.752525 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:53.752891 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:53.753176 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:53.753177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:53.753177 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:53.753319 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:53.753667 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:53.753672 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:53.753799 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 14:35:53.753886 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:35:53.754008 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":99,"threads_started":1}
I20260808 14:35:53.754212 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:53.744792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:34727 (local address 127.20.81.62:44833)
0808 14:35:53.744874 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:53.744876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:53.745073 (+ 197us) server_negotiation.cc:407] Connection header received
0808 14:35:53.745552 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:53.745553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:53.745563 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:53.745615 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:53.746554 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.747143 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.748101 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.748302 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.748355 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:53.750865 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:53.750866 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:53.750867 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:53.750875 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:53.752415 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:53.753019 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:53.753020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:53.753020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:53.753097 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:53.753392 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:53.753393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:53.753393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:53.753592 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:53.753663 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:53.753933 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 14:35:53.754068 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:35:53.754940 24313 heartbeater.cc:347] Connected to a master server at 127.20.81.62:44833
I20260808 14:35:53.755064 24313 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:53.755246 24313 heartbeater.cc:511] Master 127.20.81.62:44833 requested a full tablet report, sending...
I20260808 14:35:53.755816 24105 ts_manager.cc:194] Registered new tserver with Master: cb0e93034f7f4858bb97a01d935fc7b4 (127.20.81.1:36629)
I20260808 14:35:53.756430 24105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:34727
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:35:53.775832 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44833
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:39629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:53.859571 24318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:53.859788 24318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:53.859812 24318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:53.861042 24318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:53.861085 24318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:53.861111 24318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:35:53.862572 24318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:39629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44833
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:53.862839 24318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:53.863075 24318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:53.868112 24324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:53.868121 24326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:53.868177 24323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:53.868273 24318 server_base.cc:1034] running on GCE node
I20260808 14:35:53.868608 24318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:53.868834 24318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:53.869971 24318 hybrid_clock.cc:648] HybridClock initialized: now 1786199753869960 us; error 29 us; skew 500 ppm
Aug 08 14:35:53 dist-test-slave-8n49 krb5kdc[24057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199753, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:53.872759 24318 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:35:53.873165 24318 webserver.cc:460] Webserver started at http://127.20.81.2:35673/ using document root <none> and password file <none>
I20260808 14:35:53.873368 24318 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:53.873410 24318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:53.873503 24318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:53.874529 24318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "a607532a15cb48bd83e815b649dafd9f"
format_stamp: "Formatted at 2026-08-08 14:35:53 on dist-test-slave-8n49"
server_key: "cce200bedda14accb8aa259954862689"
server_key_iv: "d028e37689af23ecf2221b3dbe9f888f"
server_key_version: "encryptionkey@0"
I20260808 14:35:53.874840 24318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "a607532a15cb48bd83e815b649dafd9f"
format_stamp: "Formatted at 2026-08-08 14:35:53 on dist-test-slave-8n49"
server_key: "cce200bedda14accb8aa259954862689"
server_key_iv: "d028e37689af23ecf2221b3dbe9f888f"
server_key_version: "encryptionkey@0"
I20260808 14:35:53.876099 24318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:35:53.876832 24333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:53.876989 24318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:53.877084 24318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "a607532a15cb48bd83e815b649dafd9f"
format_stamp: "Formatted at 2026-08-08 14:35:53 on dist-test-slave-8n49"
server_key: "cce200bedda14accb8aa259954862689"
server_key_iv: "d028e37689af23ecf2221b3dbe9f888f"
server_key_version: "encryptionkey@0"
I20260808 14:35:53.877138 24318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:53.892414 24318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:53.894511 24318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:53.894627 24318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:53.894819 24318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:53.895148 24318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:53.895182 24318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:53.895205 24318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:53.895248 24318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:53.900936 24318 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:35427
I20260808 14:35:53.901023 24454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:35427 every 8 connection(s)
I20260808 14:35:53.901347 24318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:35:53 dist-test-slave-8n49 krb5kdc[24057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199753, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:53.910744 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:53.902199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:39535 (local address 127.20.81.62:44833)
0808 14:35:53.902262 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:53.902264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:53.902498 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:35:53.902994 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:53.902995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:53.903004 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:53.903065 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:53.903976 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.904467 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.905446 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.905642 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.905697 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:53.907978 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:53.907979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:53.907979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:53.907988 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:53.909336 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:53.909744 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:53.909745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:53.909745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:53.909804 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:53.910075 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:53.910076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:53.910077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:53.910197 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:53.910276 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:53.910561 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 14:35:53.910653 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:35:53.910905 24457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:53.902174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44833 (local address 127.20.81.2:39535)
0808 14:35:53.902357 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:53.902408 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:53.902908 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:53.903124 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:53.903127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:53.903702 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:53.903900 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:53.903905 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.904564 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.904565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:53.905363 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:53.905365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:53.905719 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:53.905720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:53.905829 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:53.906369 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:53.906378 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:53.907883 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:53.909424 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:53.909431 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:53.909433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:53.909662 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:53.909877 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:53.909878 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:53.909879 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:53.909998 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:53.910267 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:53.910274 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:53.910415 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 14:35:53.910520 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 14:35:53.910675 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260808 14:35:53.911051 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 24318
I20260808 14:35:53.911190 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:53.911437 20804 external_mini_cluster.cc:1428] Setting key e6c82a94f78b60e692800fb37eac0ca3
I20260808 14:35:53.911458 24455 heartbeater.cc:347] Connected to a master server at 127.20.81.62:44833
I20260808 14:35:53.911556 24455 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:53.911759 24455 heartbeater.cc:511] Master 127.20.81.62:44833 requested a full tablet report, sending...
I20260808 14:35:53.912108 24105 ts_manager.cc:194] Registered new tserver with Master: a607532a15cb48bd83e815b649dafd9f (127.20.81.2:35427)
I20260808 14:35:53.912496 24105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:39535
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:35:53.939749 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44833
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:39629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:54.023527 24462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:54.023725 24462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:54.023747 24462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:54.025270 24462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:54.025326 24462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:54.025370 24462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:35:54.027294 24462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:39629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44833
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:54.027575 24462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:54.027839 24462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:54.033125 24471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:54.033113 24469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:54.033272 24462 server_base.cc:1034] running on GCE node
W20260808 14:35:54.033141 24467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:54.033537 24462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:54.033732 24462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:54.034875 24462 hybrid_clock.cc:648] HybridClock initialized: now 1786199754034861 us; error 27 us; skew 500 ppm
Aug 08 14:35:54 dist-test-slave-8n49 krb5kdc[24057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199754, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:54.037457 24462 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:35:54.037881 24462 webserver.cc:460] Webserver started at http://127.20.81.3:33925/ using document root <none> and password file <none>
I20260808 14:35:54.038115 24462 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:54.038185 24462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:54.038331 24462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:54.039458 24462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "e5a4c0093eac4526b24a0f9784b513dc"
format_stamp: "Formatted at 2026-08-08 14:35:54 on dist-test-slave-8n49"
server_key: "6c73f904d3ebe636e97dd5e50357ad2e"
server_key_iv: "7b1521ffeb2dede9b459097469b295b4"
server_key_version: "encryptionkey@0"
I20260808 14:35:54.039822 24462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "e5a4c0093eac4526b24a0f9784b513dc"
format_stamp: "Formatted at 2026-08-08 14:35:54 on dist-test-slave-8n49"
server_key: "6c73f904d3ebe636e97dd5e50357ad2e"
server_key_iv: "7b1521ffeb2dede9b459097469b295b4"
server_key_version: "encryptionkey@0"
I20260808 14:35:54.041288 24462 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:35:54.042017 24478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:54.042196 24462 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:54.042300 24462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "e5a4c0093eac4526b24a0f9784b513dc"
format_stamp: "Formatted at 2026-08-08 14:35:54 on dist-test-slave-8n49"
server_key: "6c73f904d3ebe636e97dd5e50357ad2e"
server_key_iv: "7b1521ffeb2dede9b459097469b295b4"
server_key_version: "encryptionkey@0"
I20260808 14:35:54.042375 24462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:54.062693 24462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:54.064513 24462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:54.064702 24462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:54.064949 24462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:54.065301 24462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:54.065336 24462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:54.065359 24462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:54.065407 24462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:54.071441 24462 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:34693
I20260808 14:35:54.071529 24599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:34693 every 8 connection(s)
I20260808 14:35:54.071854 24462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:54.075264 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 24462
I20260808 14:35:54.075361 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:54.075539 20804 external_mini_cluster.cc:1428] Setting key 4659d32ef9c1cc1cc357ffcf297d8704
Aug 08 14:35:54 dist-test-slave-8n49 krb5kdc[24057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199754, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:54.081190 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:54.072612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:46053 (local address 127.20.81.62:44833)
0808 14:35:54.072678 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:54.072680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:54.072857 (+ 177us) server_negotiation.cc:407] Connection header received
0808 14:35:54.073332 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:54.073334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:54.073344 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:54.073430 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:54.074286 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:54.074776 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:54.076035 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:54.076294 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:54.076365 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:54.078404 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:54.078405 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:54.078406 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:54.078412 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:54.079936 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:54.080312 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:54.080313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:54.080313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:54.080364 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:54.080632 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:54.080633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:54.080633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:54.080739 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:54.080789 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:54.081057 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 14:35:54.081129 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:35:54.081348 24602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:54.072564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44833 (local address 127.20.81.3:46053)
0808 14:35:54.072731 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:54.072773 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:54.073251 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:54.073483 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:54.073486 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:54.074029 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:54.074210 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:54.074215 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:54.074857 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:54.074858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:54.075913 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:54.075916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:54.076382 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:54.076384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:54.076592 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:54.077010 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:54.077017 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:54.078321 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:54.080004 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:54.080009 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:54.080011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:54.080237 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:54.080426 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:54.080427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:54.080427 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:54.080523 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:54.080793 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:54.080798 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:54.080951 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 14:35:54.081025 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:35:54.081139 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
I20260808 14:35:54.081861 24600 heartbeater.cc:347] Connected to a master server at 127.20.81.62:44833
I20260808 14:35:54.081944 24600 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:54.082072 24600 heartbeater.cc:511] Master 127.20.81.62:44833 requested a full tablet report, sending...
I20260808 14:35:54.082392 24105 ts_manager.cc:194] Registered new tserver with Master: e5a4c0093eac4526b24a0f9784b513dc (127.20.81.3:34693)
I20260808 14:35:54.082710 24105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:46053
I20260808 14:35:54.087383 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:35:54 dist-test-slave-8n49 krb5kdc[24057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199754, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 14:35:54 dist-test-slave-8n49 krb5kdc[24057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199754, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:54.109712 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:54.102902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49626 (local address 127.20.81.62:44833)
0808 14:35:54.102972 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:54.102974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:54.103089 (+ 115us) server_negotiation.cc:407] Connection header received
0808 14:35:54.103146 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:54.103147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:54.103155 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:54.103208 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:54.103743 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:54.104210 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:54.105012 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:54.105189 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:54.105240 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:54.107358 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:54.107359 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:54.107359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:54.107365 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:54.108617 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:54.108970 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:54.108971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:54.108972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:54.109022 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:54.109209 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:54.109210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:54.109210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:54.109348 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:54.109433 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:54.109585 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 14:35:54.109648 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 14:35:54.109961 24105 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49626
I20260808 14:35:54.110409 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 24173
I20260808 14:35:54.117424 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 24318
I20260808 14:35:54.123575 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 24462
I20260808 14:35:54.129702 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 24072
2026-08-08T14:35:54Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1911 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:54 dist-test-slave-8n49 krb5kdc[24612](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:54 dist-test-slave-8n49 krb5kdc[24612](info): set up 2 sockets
Aug 08 14:35:54 dist-test-slave-8n49 krb5kdc[24612](info): commencing operation
krb5kdc: starting...
W20260808 14:35:55.203971 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:35:55 dist-test-slave-8n49 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:35:55.326885 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33987
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:33987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:55.412111 24628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:55.412307 24628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:55.412330 24628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:55.413465 24628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:55.413501 24628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:55.413516 24628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:55.413528 24628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:55.413540 24628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:55.414981 24628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:33987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:55.415189 24628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:55.415371 24628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:55.420186 24634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:55.420178 24635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:55.420311 24628 server_base.cc:1034] running on GCE node
W20260808 14:35:55.420401 24637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:55.420701 24628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:55.421013 24628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:55.422153 24628 hybrid_clock.cc:648] HybridClock initialized: now 1786199755422134 us; error 39 us; skew 500 ppm
Aug 08 14:35:55 dist-test-slave-8n49 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199755, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:55.424736 24628 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:35:55.425205 24628 webserver.cc:460] Webserver started at http://127.20.81.62:40555/ using document root <none> and password file <none>
I20260808 14:35:55.425451 24628 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:55.425520 24628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:55.425662 24628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:55.426734 24628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "c9227491f96f448ea2ba3c9e9dc65c19"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "ef53dba2ad058f07382ae0f4365d71d4"
server_key_iv: "8e33a772eb45919bca150b3f1190a276"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.427104 24628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "c9227491f96f448ea2ba3c9e9dc65c19"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "ef53dba2ad058f07382ae0f4365d71d4"
server_key_iv: "8e33a772eb45919bca150b3f1190a276"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.428460 24628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:35:55.429251 24644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.429430 24628 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:55.429526 24628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "c9227491f96f448ea2ba3c9e9dc65c19"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "ef53dba2ad058f07382ae0f4365d71d4"
server_key_iv: "8e33a772eb45919bca150b3f1190a276"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.429585 24628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:55.446224 24628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:55.448531 24628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:55.448750 24628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:55.452941 24628 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:33987
I20260808 14:35:55.452983 24703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:33987 every 8 connection(s)
I20260808 14:35:55.453521 24628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:55.454313 24704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:55.456929 24704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19: Bootstrap starting.
I20260808 14:35:55.457545 24704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:55.457826 24704 log.cc:824] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:55.458523 24704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19: No bootstrap required, opened a new log
I20260808 14:35:55.460281 24704 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9227491f96f448ea2ba3c9e9dc65c19" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33987 } }
I20260808 14:35:55.460435 24704 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:55.460461 24704 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9227491f96f448ea2ba3c9e9dc65c19, State: Initialized, Role: FOLLOWER
I20260808 14:35:55.460641 24704 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9227491f96f448ea2ba3c9e9dc65c19" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33987 } }
I20260808 14:35:55.460731 24704 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:55.460755 24704 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:55.460788 24704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:55.461755 24704 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9227491f96f448ea2ba3c9e9dc65c19" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33987 } }
I20260808 14:35:55.461853 24704 leader_election.cc:302] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9227491f96f448ea2ba3c9e9dc65c19; no voters:
I20260808 14:35:55.461997 24704 leader_election.cc:288] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:55.462096 24707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:55.462232 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 24628
I20260808 14:35:55.462304 24704 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:55.462342 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:55.462329 24707 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [term 1 LEADER]: Becoming Leader. State: Replica: c9227491f96f448ea2ba3c9e9dc65c19, State: Running, Role: LEADER
I20260808 14:35:55.462430 24707 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9227491f96f448ea2ba3c9e9dc65c19" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33987 } }
I20260808 14:35:55.462531 20804 external_mini_cluster.cc:1428] Setting key c579f188872fa52d1200cade1c775bfe
I20260808 14:35:55.463357 24708 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9227491f96f448ea2ba3c9e9dc65c19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9227491f96f448ea2ba3c9e9dc65c19" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33987 } } }
I20260808 14:35:55.463402 24709 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9227491f96f448ea2ba3c9e9dc65c19. Latest consensus state: current_term: 1 leader_uuid: "c9227491f96f448ea2ba3c9e9dc65c19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9227491f96f448ea2ba3c9e9dc65c19" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33987 } } }
I20260808 14:35:55.463481 24708 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:55.463482 24709 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:55.463856 24723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:55.464706 24723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:55.466503 24723 catalog_manager.cc:1347] Generated new cluster ID: 7c4ae47fe17e4fe4a217dfbc1302b9c3
I20260808 14:35:55.466558 24723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:35:55 dist-test-slave-8n49 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:55.475561 24718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:55.463051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50876 (local address 127.20.81.62:33987)
0808 14:35:55.463255 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:55.463265 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:55.463680 (+ 415us) server_negotiation.cc:407] Connection header received
0808 14:35:55.463844 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:55.463854 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:55.463917 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:55.464037 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:55.465062 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.466249 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.467516 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.468135 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.468230 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:55.471221 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:55.471226 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:55.471227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:55.471241 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:55.473544 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:55.473937 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:55.473941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:55.473942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:55.474075 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:55.474288 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:55.474289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:55.474289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:55.474855 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:55.475059 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:55.475139 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:35:55.475299 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":89,"threads_started":1}
I20260808 14:35:55.480923 24723 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:55.481412 24723 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:55.492470 24723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9227491f96f448ea2ba3c9e9dc65c19: Generated new TSK 0
I20260808 14:35:55.492722 24723 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:35:55.527235 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33987
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:55.609719 24732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:55.609957 24732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:55.609997 24732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:55.611177 24732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:55.611248 24732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:55.611294 24732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:35:55.612962 24732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:55.613226 24732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:55.613471 24732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:55.618753 24740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:55.618728 24738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:55.618733 24737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:55.618794 24732 server_base.cc:1034] running on GCE node
I20260808 14:35:55.619208 24732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:55.619501 24732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:55.620682 24732 hybrid_clock.cc:648] HybridClock initialized: now 1786199755620656 us; error 38 us; skew 500 ppm
Aug 08 14:35:55 dist-test-slave-8n49 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199755, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:55.623143 24732 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:35:55.623586 24732 webserver.cc:460] Webserver started at http://127.20.81.1:35791/ using document root <none> and password file <none>
I20260808 14:35:55.623839 24732 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:55.623911 24732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:55.624060 24732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:55.625186 24732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "aab3f94a5e624e7694dd3d2113cc3068"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "6602f5b613c75d9603bc6173a7d9078b"
server_key_iv: "eb02726cdf65a86de616b29a7babe136"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.625602 24732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "aab3f94a5e624e7694dd3d2113cc3068"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "6602f5b613c75d9603bc6173a7d9078b"
server_key_iv: "eb02726cdf65a86de616b29a7babe136"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.626945 24732 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:35:55.627681 24748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.627849 24732 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:55.627956 24732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "aab3f94a5e624e7694dd3d2113cc3068"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "6602f5b613c75d9603bc6173a7d9078b"
server_key_iv: "eb02726cdf65a86de616b29a7babe136"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.628033 24732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:55.645015 24732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:55.646925 24732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:55.647102 24732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:55.647365 24732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:55.647704 24732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:55.647760 24732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.647801 24732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:55.647833 24732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.654105 24732 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:36921
I20260808 14:35:55.654222 24874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:36921 every 8 connection(s)
I20260808 14:35:55.654539 24732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:35:55 dist-test-slave-8n49 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199755, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:55.663234 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 24732
I20260808 14:35:55.663385 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:55.663611 20804 external_mini_cluster.cc:1428] Setting key 4c28df9c39ed77bc29964b598df32da1
I20260808 14:35:55.664731 24718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:55.655493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:55279 (local address 127.20.81.62:33987)
0808 14:35:55.655593 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:55.655595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:55.655726 (+ 131us) server_negotiation.cc:407] Connection header received
0808 14:35:55.656694 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:55.656695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:55.656711 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:55.656763 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:55.657358 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.657882 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.658929 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.659140 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.659200 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:55.661488 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:55.661490 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:55.661490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:55.661497 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:55.662921 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:55.663491 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:55.663493 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:55.663493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:55.663600 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:55.663901 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:55.663903 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:55.663903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:55.664055 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:55.664115 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:55.664469 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 14:35:55.664595 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:35:55.664849 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:55.655418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33987 (local address 127.20.81.1:55279)
0808 14:35:55.655575 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:55.655631 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:55.656589 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:55.656822 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:55.656825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:55.657084 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:55.657284 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:55.657288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.658019 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.658020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:55.658837 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:55.658839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.659222 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.659224 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:55.659338 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:55.659936 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:55.659951 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:55.661376 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:55.663032 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:55.663039 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:55.663042 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:55.663352 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:55.663668 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:55.663669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:55.663669 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:55.663805 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:55.664129 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:55.664136 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:55.664303 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 14:35:55.664445 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 14:35:55.664676 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260808 14:35:55.665313 24875 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33987
I20260808 14:35:55.665423 24875 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:55.665632 24875 heartbeater.cc:511] Master 127.20.81.62:33987 requested a full tablet report, sending...
I20260808 14:35:55.666163 24663 ts_manager.cc:194] Registered new tserver with Master: aab3f94a5e624e7694dd3d2113cc3068 (127.20.81.1:36921)
I20260808 14:35:55.666790 24663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:55279
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:35:55.690989 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33987
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:55.772305 24880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:55.772526 24880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:55.772595 24880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:55.773734 24880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:55.773774 24880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:55.773800 24880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:35:55.775395 24880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:55.775591 24880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:55.775768 24880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:55.780803 24889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:55.780812 24887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:55.780803 24886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:55.781060 24880 server_base.cc:1034] running on GCE node
I20260808 14:35:55.781379 24880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:55.781638 24880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:55.782804 24880 hybrid_clock.cc:648] HybridClock initialized: now 1786199755782789 us; error 28 us; skew 500 ppm
Aug 08 14:35:55 dist-test-slave-8n49 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199755, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:55.785588 24880 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:35:55.786046 24880 webserver.cc:460] Webserver started at http://127.20.81.2:40101/ using document root <none> and password file <none>
I20260808 14:35:55.786283 24880 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:55.786329 24880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:55.786506 24880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:55.787601 24880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "d8c2d723acf0446a9f9eb9a4cbe6316e"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "17462ceb01a772bf470792b076a7e0f0"
server_key_iv: "0e43387e0fabda9c1e26b4a9c2f25026"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.787966 24880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "d8c2d723acf0446a9f9eb9a4cbe6316e"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "17462ceb01a772bf470792b076a7e0f0"
server_key_iv: "0e43387e0fabda9c1e26b4a9c2f25026"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.789376 24880 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:35:55.790120 24897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.790311 24880 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:35:55.790405 24880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "d8c2d723acf0446a9f9eb9a4cbe6316e"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "17462ceb01a772bf470792b076a7e0f0"
server_key_iv: "0e43387e0fabda9c1e26b4a9c2f25026"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.790480 24880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:55.825891 24880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:55.827757 24880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:55.827913 24880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:55.828169 24880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:55.828477 24880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:55.828514 24880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.828536 24880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:55.828599 24880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.834725 24880 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:33947
I20260808 14:35:55.834797 25017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:33947 every 8 connection(s)
I20260808 14:35:55.835129 24880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:35:55.836032 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 24880
I20260808 14:35:55.836153 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:55.836354 20804 external_mini_cluster.cc:1428] Setting key 3d6c06c12b8d58956d2db89a5c8dcada
Aug 08 14:35:55 dist-test-slave-8n49 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199755, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:35:55.846684 24718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:55.835993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:59507 (local address 127.20.81.62:33987)
0808 14:35:55.836050 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:55.836052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:55.836256 (+ 204us) server_negotiation.cc:407] Connection header received
0808 14:35:55.837614 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:55.837615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:55.837629 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:55.837681 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:55.838366 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.839166 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.840217 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.840583 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.840657 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:55.843306 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:55.843308 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:55.843308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:55.843318 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:55.845030 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:55.845446 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:55.845447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:55.845449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:55.845514 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:55.845923 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:55.845924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:55.845925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:55.846081 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:55.846156 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:55.846512 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 14:35:55.846606 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:35:55.846818 25020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:55.835909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33987 (local address 127.20.81.2:59507)
0808 14:35:55.836106 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:55.836166 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:55.837497 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:55.837767 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:55.837771 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:55.838053 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:55.838261 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:55.838266 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.839295 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.839297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:55.840128 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:55.840131 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.840670 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.840671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:55.840781 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:55.841363 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:55.841372 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:55.843207 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:55.845116 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:55.845123 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:55.845125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:55.845359 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:55.845727 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:55.845728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:55.845728 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:55.845837 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:55.846171 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:55.846179 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:55.846352 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 14:35:55.846463 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:35:55.846600 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":108,"threads_started":1}
I20260808 14:35:55.847345 25018 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33987
I20260808 14:35:55.847482 25018 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:55.847675 25018 heartbeater.cc:511] Master 127.20.81.62:33987 requested a full tablet report, sending...
I20260808 14:35:55.848057 24663 ts_manager.cc:194] Registered new tserver with Master: d8c2d723acf0446a9f9eb9a4cbe6316e (127.20.81.2:33947)
I20260808 14:35:55.848443 24663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:59507
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:35:55.864145 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33987
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:55.946324 25023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:55.946558 25023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:55.946605 25023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:55.947743 25023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:55.947813 25023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:55.947861 25023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:35:55.949515 25023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:55.949782 25023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:55.950032 25023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:55.955029 25029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:55.955087 25023 server_base.cc:1034] running on GCE node
W20260808 14:35:55.955021 25032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:55.955022 25028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:55.955466 25023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:55.955726 25023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:55.956864 25023 hybrid_clock.cc:648] HybridClock initialized: now 1786199755956852 us; error 26 us; skew 500 ppm
Aug 08 14:35:55 dist-test-slave-8n49 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199755, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:55.959396 25023 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:35:55.959836 25023 webserver.cc:460] Webserver started at http://127.20.81.3:33857/ using document root <none> and password file <none>
I20260808 14:35:55.960060 25023 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:55.960130 25023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:55.960289 25023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:55.961418 25023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "5ae840b277664f19a64e3d90f993e044"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "1d17c0c865d960d73f1669a7dc3cb964"
server_key_iv: "2ff752535457da407f62f00ba1c098c0"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.961793 25023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "5ae840b277664f19a64e3d90f993e044"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "1d17c0c865d960d73f1669a7dc3cb964"
server_key_iv: "2ff752535457da407f62f00ba1c098c0"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.963301 25023 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:35:55.964169 25040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.964351 25023 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:55.964453 25023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "5ae840b277664f19a64e3d90f993e044"
format_stamp: "Formatted at 2026-08-08 14:35:55 on dist-test-slave-8n49"
server_key: "1d17c0c865d960d73f1669a7dc3cb964"
server_key_iv: "2ff752535457da407f62f00ba1c098c0"
server_key_version: "encryptionkey@0"
I20260808 14:35:55.964555 25023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:55.977793 25023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:55.980052 25023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:55.980207 25023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:55.980443 25023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:55.980810 25023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:55.980865 25023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.980911 25023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:55.980944 25023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:55.986622 25023 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:40323
I20260808 14:35:55.986716 25162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:40323 every 8 connection(s)
I20260808 14:35:55.987022 25023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:55.989661 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 25023
I20260808 14:35:55.989764 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:55.989946 20804 external_mini_cluster.cc:1428] Setting key 373deae24ff34afd153c438df616934e
Aug 08 14:35:55 dist-test-slave-8n49 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199755, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:55.996919 24718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:55.987781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:46627 (local address 127.20.81.62:33987)
0808 14:35:55.987865 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:55.987869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:55.988048 (+ 179us) server_negotiation.cc:407] Connection header received
0808 14:35:55.989128 (+ 1080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:55.989129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:55.989144 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:55.989203 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:55.989914 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.990719 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.991728 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.991910 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.991965 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:55.994250 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:55.994252 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:55.994253 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:55.994279 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:55.995473 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:55.995874 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:55.995875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:55.995875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:55.995940 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:55.996197 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:55.996198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:55.996199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:55.996324 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:55.996397 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:55.996751 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 14:35:55.996830 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:35:55.997107 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:55.987756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33987 (local address 127.20.81.3:46627)
0808 14:35:55.987924 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:55.987967 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:55.989002 (+ 1035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:55.989282 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:55.989286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:55.989531 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:55.989769 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:55.989775 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.990835 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.990836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:55.991650 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:55.991653 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:55.991992 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:55.991993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:55.992096 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:55.992710 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:55.992719 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:55.994150 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:55.995559 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:55.995574 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:55.995576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:55.995794 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:55.996020 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:55.996021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:55.996021 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:55.996127 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:55.996401 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:55.996408 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:55.996542 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 14:35:55.996714 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 14:35:55.996871 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260808 14:35:55.997632 25163 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33987
I20260808 14:35:55.997715 25163 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:55.997862 25163 heartbeater.cc:511] Master 127.20.81.62:33987 requested a full tablet report, sending...
I20260808 14:35:55.998195 24663 ts_manager.cc:194] Registered new tserver with Master: 5ae840b277664f19a64e3d90f993e044 (127.20.81.3:40323)
I20260808 14:35:55.998526 24663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:46627
I20260808 14:35:56.001590 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:35:56 dist-test-slave-8n49 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:35:56 dist-test-slave-8n49 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:35:56.026065 25170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:56.017985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37746 (local address 127.20.81.1:36921)
0808 14:35:56.018180 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:56.018186 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:56.018196 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:35:56.018236 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:56.018238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:56.018254 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:56.018323 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:56.018913 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:56.019673 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:56.020413 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:56.020839 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:56.020905 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:56.023200 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:56.023208 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:56.023208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:56.023215 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:56.024999 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:56.025343 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:56.025346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:56.025347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:56.025441 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:56.025618 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:56.025618 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:56.025619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:56.025749 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:56.025859 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:56.025922 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 14:35:56.025984 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":112,"threads_started":1}
Aug 08 14:35:56 dist-test-slave-8n49 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:56.035223 24718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:56.027543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50882 (local address 127.20.81.62:33987)
0808 14:35:56.027628 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:56.027630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:56.027638 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:35:56.027676 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:56.027677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:56.027687 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:56.027728 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:56.028182 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:56.028735 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:56.029409 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:56.029601 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:56.029655 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:56.032104 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:56.032105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:56.032106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:56.032115 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:56.033765 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:56.034227 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:56.034228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:56.034228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:56.034296 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:56.034543 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:56.034545 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:56.034545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:56.034760 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:56.034871 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:56.035025 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 14:35:56.035111 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 14:35:56.035597 24663 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50882
I20260808 14:35:56.035990 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 24732
I20260808 14:35:56.045017 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 24880
I20260808 14:35:56.050403 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 25023
I20260808 14:35:56.055132 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 24628
2026-08-08T14:35:56Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1925 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:56 dist-test-slave-8n49 krb5kdc[25175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:56 dist-test-slave-8n49 krb5kdc[25175](info): set up 2 sockets
Aug 08 14:35:56 dist-test-slave-8n49 krb5kdc[25175](info): commencing operation
krb5kdc: starting...
W20260808 14:35:57.137391 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:35:57 dist-test-slave-8n49 krb5kdc[25175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:35:57.261574 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35491
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:36177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:35491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:57.342368 25189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:57.342614 25189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:57.342651 25189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:57.343804 25189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:57.343873 25189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:57.343899 25189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:57.343935 25189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:57.343979 25189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:57.345502 25189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:36177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:35491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:57.345770 25189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:57.346017 25189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:35:57.351496 25189 server_base.cc:1034] running on GCE node
W20260808 14:35:57.351428 25198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:57.351521 25195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:57.351430 25196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:57.351933 25189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:57.352283 25189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:57.353459 25189 hybrid_clock.cc:648] HybridClock initialized: now 1786199757353442 us; error 45 us; skew 500 ppm
Aug 08 14:35:57 dist-test-slave-8n49 krb5kdc[25175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199757, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:57.359508 25189 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:35:57.359964 25189 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:57.360046 25189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:57.360204 25189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:57.361478 25189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "797bd40036dd4cc2a2701457830e83db"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "9c77508eb64fa8430c237a0b1d95d9bc"
server_key_iv: "96110da731349bce1b6b9e7cb8174cd6"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.361871 25189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "797bd40036dd4cc2a2701457830e83db"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "9c77508eb64fa8430c237a0b1d95d9bc"
server_key_iv: "96110da731349bce1b6b9e7cb8174cd6"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.363227 25189 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:35:57.364032 25204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.364229 25189 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:57.364342 25189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "797bd40036dd4cc2a2701457830e83db"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "9c77508eb64fa8430c237a0b1d95d9bc"
server_key_iv: "96110da731349bce1b6b9e7cb8174cd6"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.364444 25189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:57.383745 25189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:57.385699 25189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:57.385869 25189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:57.390112 25189 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:35491
I20260808 14:35:57.390138 25261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:35491 every 8 connection(s)
I20260808 14:35:57.390444 25189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:57.391505 25262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:57.393940 25262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db: Bootstrap starting.
I20260808 14:35:57.394510 25262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:57.394765 25262 log.cc:824] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:57.395428 25262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db: No bootstrap required, opened a new log
I20260808 14:35:57.396466 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 25189
I20260808 14:35:57.396631 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:57.396834 20804 external_mini_cluster.cc:1428] Setting key b65d7aa49c6582692609502137bff396
I20260808 14:35:57.397346 25262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "797bd40036dd4cc2a2701457830e83db" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35491 } }
I20260808 14:35:57.397547 25262 raft_consensus.cc:374] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:57.397599 25262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 797bd40036dd4cc2a2701457830e83db, State: Initialized, Role: FOLLOWER
I20260808 14:35:57.397735 25262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "797bd40036dd4cc2a2701457830e83db" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35491 } }
I20260808 14:35:57.397809 25262 raft_consensus.cc:388] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:57.397831 25262 raft_consensus.cc:482] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:57.397899 25262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:57.398425 25262 raft_consensus.cc:504] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "797bd40036dd4cc2a2701457830e83db" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35491 } }
I20260808 14:35:57.398569 25262 leader_election.cc:302] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 797bd40036dd4cc2a2701457830e83db; no voters:
I20260808 14:35:57.398733 25262 leader_election.cc:288] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:57.398775 25267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:57.398938 25267 raft_consensus.cc:686] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [term 1 LEADER]: Becoming Leader. State: Replica: 797bd40036dd4cc2a2701457830e83db, State: Running, Role: LEADER
I20260808 14:35:57.399016 25262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:57.399041 25267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "797bd40036dd4cc2a2701457830e83db" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35491 } }
I20260808 14:35:57.399420 25268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "797bd40036dd4cc2a2701457830e83db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "797bd40036dd4cc2a2701457830e83db" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35491 } } }
I20260808 14:35:57.399519 25268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:57.399412 25267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 797bd40036dd4cc2a2701457830e83db. Latest consensus state: current_term: 1 leader_uuid: "797bd40036dd4cc2a2701457830e83db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "797bd40036dd4cc2a2701457830e83db" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35491 } } }
I20260808 14:35:57.399709 25267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:57.399855 25275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:57.400355 25275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:57.402070 25275 catalog_manager.cc:1347] Generated new cluster ID: 05d10da158f24f1e9d210ca897d0dce6
I20260808 14:35:57.402122 25275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:35:57 dist-test-slave-8n49 krb5kdc[25175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:57.409082 25266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.397450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55714 (local address 127.20.81.62:35491)
0808 14:35:57.397676 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.397686 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.397743 (+ 57us) server_negotiation.cc:407] Connection header received
0808 14:35:57.398145 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.398152 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.398200 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.398344 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:57.399231 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.400718 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.401908 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.402512 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.402633 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.405460 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:57.405464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:57.405464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:57.405476 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:57.407410 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.407832 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.407835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.407835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.407943 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.408163 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.408163 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.408164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.408455 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:57.408627 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.408760 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.408887 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":105,"threads_started":1}
I20260808 14:35:57.411995 25275 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:57.412773 25275 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:57.424175 25275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db: Generated new TSK 0
I20260808 14:35:57.424410 25275 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:35:57.452315 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35491
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:36177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:57.536355 25290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:57.536595 25290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:57.536620 25290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:57.537801 25290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:57.537840 25290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:57.537868 25290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:35:57.539316 25290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:36177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:57.539510 25290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:57.539686 25290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:57.544627 25297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:57.544646 25299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:57.544646 25296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:57.544716 25290 server_base.cc:1034] running on GCE node
I20260808 14:35:57.545035 25290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:57.545280 25290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:57.546468 25290 hybrid_clock.cc:648] HybridClock initialized: now 1786199757546453 us; error 45 us; skew 500 ppm
Aug 08 14:35:57 dist-test-slave-8n49 krb5kdc[25175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199757, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:57.549151 25290 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:35:57.549539 25290 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:57.549611 25290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:57.549762 25290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:57.550832 25290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "b2353c8ad7bd436989bb81feec238ad0"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "cddc1ec4028dd657ae488001b445c5b4"
server_key_iv: "517b66be33ef02dd2a5e8674fee58abe"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.551196 25290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "b2353c8ad7bd436989bb81feec238ad0"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "cddc1ec4028dd657ae488001b445c5b4"
server_key_iv: "517b66be33ef02dd2a5e8674fee58abe"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.552539 25290 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:35:57.553331 25305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.553506 25290 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:35:57.553609 25290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "b2353c8ad7bd436989bb81feec238ad0"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "cddc1ec4028dd657ae488001b445c5b4"
server_key_iv: "517b66be33ef02dd2a5e8674fee58abe"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.553694 25290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:57.563932 25290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:57.565758 25290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:57.565918 25290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:57.566150 25290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:57.566465 25290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:57.566519 25290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.566565 25290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:57.566601 25290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.572547 25290 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:35909
I20260808 14:35:57.572607 25427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:35909 every 8 connection(s)
I20260808 14:35:57.572932 25290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:35:57.578210 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 25290
I20260808 14:35:57.578302 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:57.578526 20804 external_mini_cluster.cc:1428] Setting key e7f634ee28a7fc7d8462aa2b9e6fef9e
Aug 08 14:35:57 dist-test-slave-8n49 krb5kdc[25175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199757, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:57.582976 25266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.573710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:53949 (local address 127.20.81.62:35491)
0808 14:35:57.573783 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.573786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.574020 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:35:57.574498 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.574500 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.574516 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.574584 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:57.575512 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.576039 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.577101 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.577313 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.577390 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.579907 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:57.579909 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:57.579909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:57.579921 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:57.581489 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.581986 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.581987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.581987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.582040 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.582325 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.582326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.582326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.582436 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:57.582496 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.582823 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.582893 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:35:57.583278 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.573672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35491 (local address 127.20.81.1:53949)
0808 14:35:57.573853 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:57.573897 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:57.574390 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:57.574641 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:57.574645 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:57.574908 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:57.575417 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.575422 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.576137 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.576138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.577018 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.577020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.577398 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.577399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.577507 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.578104 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:57.578115 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:57.579809 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:57.581574 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:57.581582 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:57.581585 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:57.581904 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:57.582106 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:57.582107 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:57.582108 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:57.582254 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:57.582506 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:57.582513 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:57.582682 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 14:35:57.582799 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 14:35:57.582982 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260808 14:35:57.583871 25428 heartbeater.cc:347] Connected to a master server at 127.20.81.62:35491
I20260808 14:35:57.583992 25428 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:57.584151 25428 heartbeater.cc:511] Master 127.20.81.62:35491 requested a full tablet report, sending...
I20260808 14:35:57.584805 25221 ts_manager.cc:194] Registered new tserver with Master: b2353c8ad7bd436989bb81feec238ad0 (127.20.81.1:35909)
I20260808 14:35:57.585803 25221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:53949
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:35:57.608144 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35491
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:36177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:57.690629 25433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:57.690833 25433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:57.690858 25433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:57.692045 25433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:57.692088 25433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:57.692144 25433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:35:57.693693 25433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:36177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:57.693940 25433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:57.694182 25433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:57.699182 25439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:57.699262 25441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:57.699172 25438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:57.699385 25433 server_base.cc:1034] running on GCE node
I20260808 14:35:57.699700 25433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:57.700002 25433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:57.701169 25433 hybrid_clock.cc:648] HybridClock initialized: now 1786199757701157 us; error 31 us; skew 500 ppm
Aug 08 14:35:57 dist-test-slave-8n49 krb5kdc[25175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199757, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:57.703658 25433 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:35:57.704025 25433 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:57.704074 25433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:57.704166 25433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:57.705237 25433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "bef116469f7a4ebcbea58b90f89b71bf"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "222f0524e85ae11009ae8b86489cc6ef"
server_key_iv: "5c2af3298c48d57f07cc2b91ae9601ac"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.705554 25433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "bef116469f7a4ebcbea58b90f89b71bf"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "222f0524e85ae11009ae8b86489cc6ef"
server_key_iv: "5c2af3298c48d57f07cc2b91ae9601ac"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.706770 25433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:35:57.707526 25447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.707751 25433 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:57.707844 25433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "bef116469f7a4ebcbea58b90f89b71bf"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "222f0524e85ae11009ae8b86489cc6ef"
server_key_iv: "5c2af3298c48d57f07cc2b91ae9601ac"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.707899 25433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:57.731714 25433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:57.733989 25433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:57.734115 25433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:57.734319 25433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:57.734697 25433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:57.734735 25433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.734758 25433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:57.734771 25433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.740504 25433 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:43091
I20260808 14:35:57.740594 25573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:43091 every 8 connection(s)
I20260808 14:35:57.740869 25433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:35:57.743628 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 25433
I20260808 14:35:57.743739 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:57.743935 20804 external_mini_cluster.cc:1428] Setting key 08052f0ec270cb3a2384a1ac62b6ecc5
Aug 08 14:35:57 dist-test-slave-8n49 krb5kdc[25175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199757, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:57.751611 25266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.741669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:43871 (local address 127.20.81.62:35491)
0808 14:35:57.741737 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.741739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.741944 (+ 205us) server_negotiation.cc:407] Connection header received
0808 14:35:57.742425 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.742426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.742439 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.742507 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:57.743499 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.744295 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.745526 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.745836 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.745919 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.748464 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:57.748466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:57.748467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:57.748475 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:57.750115 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.750577 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.750578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.750579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.750643 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.750914 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.750915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.750915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.751042 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:57.751117 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.751413 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.751517 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:35:57.751801 25576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.741626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35491 (local address 127.20.81.2:43871)
0808 14:35:57.741793 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:57.741836 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:57.742332 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:57.742588 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:57.742592 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:57.742864 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:57.743380 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.743385 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.744411 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.744413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.745414 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.745417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.745932 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.745933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.746050 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.746657 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:57.746670 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:57.748360 (+ 1690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:57.750227 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:57.750236 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:57.750239 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:57.750483 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:57.750716 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:57.750717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:57.750717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:57.750838 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:57.751119 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:57.751128 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:57.751273 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 14:35:57.751380 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 14:35:57.751548 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
I20260808 14:35:57.752338 25574 heartbeater.cc:347] Connected to a master server at 127.20.81.62:35491
I20260808 14:35:57.752476 25574 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:57.752686 25574 heartbeater.cc:511] Master 127.20.81.62:35491 requested a full tablet report, sending...
I20260808 14:35:57.753167 25221 ts_manager.cc:194] Registered new tserver with Master: bef116469f7a4ebcbea58b90f89b71bf (127.20.81.2:43091)
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:35:57.753731 25221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:43871
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:35:57.775025 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35491
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:36177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:57.858953 25579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:57.859155 25579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:57.859179 25579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:57.860353 25579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:57.860390 25579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:57.860417 25579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:35:57.861939 25579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:36177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:57.862133 25579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:57.862311 25579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:57.867336 25585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:57.867359 25588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:57.867336 25586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:57.867607 25579 server_base.cc:1034] running on GCE node
I20260808 14:35:57.867813 25579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:57.868070 25579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:57.869212 25579 hybrid_clock.cc:648] HybridClock initialized: now 1786199757869200 us; error 27 us; skew 500 ppm
Aug 08 14:35:57 dist-test-slave-8n49 krb5kdc[25175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199757, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:57.871790 25579 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:35:57.872104 25579 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:57.872149 25579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:57.872242 25579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:57.873375 25579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "b4d01e396a5643dda0dbe30c68dce5d5"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "e7dfdbc332fd8b02dd5e0e710548a12c"
server_key_iv: "42f1f9fd7c66dd9d8489d87a21c4e530"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.873678 25579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "b4d01e396a5643dda0dbe30c68dce5d5"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "e7dfdbc332fd8b02dd5e0e710548a12c"
server_key_iv: "42f1f9fd7c66dd9d8489d87a21c4e530"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.874910 25579 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:35:57.875648 25594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.875890 25579 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:57.875994 25579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "b4d01e396a5643dda0dbe30c68dce5d5"
format_stamp: "Formatted at 2026-08-08 14:35:57 on dist-test-slave-8n49"
server_key: "e7dfdbc332fd8b02dd5e0e710548a12c"
server_key_iv: "42f1f9fd7c66dd9d8489d87a21c4e530"
server_key_version: "encryptionkey@0"
I20260808 14:35:57.876101 25579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:57.886869 25579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:57.888840 25579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:57.889004 25579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:57.889236 25579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:57.889806 25579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:57.889853 25579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.889878 25579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:57.889938 25579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:57.895788 25579 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:38903
I20260808 14:35:57.895851 25722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:38903 every 8 connection(s)
I20260808 14:35:57.896122 25579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:57.900913 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 25579
I20260808 14:35:57.901050 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:57.901276 20804 external_mini_cluster.cc:1428] Setting key cdf5f1e918d7a128f774245b2f628b06
Aug 08 14:35:57 dist-test-slave-8n49 krb5kdc[25175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199757, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:35:57.905793 25266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.896905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:50417 (local address 127.20.81.62:35491)
0808 14:35:57.897037 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.897039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.897232 (+ 193us) server_negotiation.cc:407] Connection header received
0808 14:35:57.897747 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.897748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.897760 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.897828 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:57.898900 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.899428 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.900634 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.900833 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.900897 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.903358 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:57.903359 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:57.903360 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:57.903367 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:57.904611 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.905004 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.905005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.905005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.905060 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.905281 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.905282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.905282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.905396 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:57.905445 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.905665 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.905729 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:35:57.906036 25725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.896869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35491 (local address 127.20.81.3:50417)
0808 14:35:57.897097 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:57.897139 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:57.897619 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:57.897904 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:57.897908 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:57.898205 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:57.898748 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.898754 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.899517 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.899518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.900470 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.900473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.900926 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.900928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.901089 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.901766 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:57.901774 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:57.903255 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:57.904694 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:57.904700 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:57.904703 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:57.904925 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:57.905125 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:57.905125 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:57.905125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:57.905221 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:57.905463 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:57.905466 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:57.905576 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 14:35:57.905651 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:35:57.905768 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":89,"threads_started":1}
I20260808 14:35:57.906584 25723 heartbeater.cc:347] Connected to a master server at 127.20.81.62:35491
I20260808 14:35:57.906684 25723 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:57.906801 25723 heartbeater.cc:511] Master 127.20.81.62:35491 requested a full tablet report, sending...
I20260808 14:35:57.907212 25221 ts_manager.cc:194] Registered new tserver with Master: b4d01e396a5643dda0dbe30c68dce5d5 (127.20.81.3:38903)
I20260808 14:35:57.907660 25221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:50417
I20260808 14:35:57.913391 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:35:57.920859 25266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.914717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55722 (local address 127.20.81.62:35491)
0808 14:35:57.914788 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.914790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.914879 (+ 89us) server_negotiation.cc:407] Connection header received
0808 14:35:57.914957 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.914958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.914979 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.915035 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:57.915612 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.916110 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.916896 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.917114 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.917186 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.918386 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:57.918387 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:57.918388 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:57.918395 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:57.919640 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.919985 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.919986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.919987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.920043 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:57.920258 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:57.920259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:57.920259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:57.920413 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:57.920526 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.920672 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.920756 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:35:57.922587 25221 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:57.924270 25221 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:57.930985 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.926907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50476 (local address 127.20.81.1:35909)
0808 14:35:57.927079 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.927084 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.927096 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:35:57.927140 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.927143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.927162 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.927254 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:57.927470 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.928743 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.930080 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.930568 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.930663 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.930728 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.930865 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.930905 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260808 14:35:57.930984 25735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.926713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35909 (local address 127.0.0.1:50476)
0808 14:35:57.926880 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:57.926918 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:57.926988 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:57.927257 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:57.927260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:57.927263 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:57.927337 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.927339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.928864 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.928865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.929989 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.929991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.930662 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.930663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.930754 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.930768 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:35:57.930842 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:35:57.930899 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":31,"spinlock_wait_cycles":768,"thread_start_us":96,"threads_started":1}
I20260808 14:35:57.931139 25737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.926713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:43091 (local address 127.0.0.1:42592)
0808 14:35:57.927097 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:57.927106 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:57.927145 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:57.927527 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:57.927528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:57.927530 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:57.927569 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.927570 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.928869 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.928870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.929788 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.929790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.930792 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.930794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.930859 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.930863 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:35:57.930914 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:35:57.930959 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":3,"thread_start_us":61,"threads_started":1}
I20260808 14:35:57.931286 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.927096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42592 (local address 127.20.81.2:43091)
0808 14:35:57.927271 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.927275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.927284 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:57.927320 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.927323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.927362 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.927438 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:57.927653 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.928764 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.929872 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.930616 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.930694 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.930754 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.931023 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.931199 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
I20260808 14:35:57.931620 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.926990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51784 (local address 127.20.81.3:38903)
0808 14:35:57.927187 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.927192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.927344 (+ 152us) server_negotiation.cc:407] Connection header received
0808 14:35:57.927475 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.927478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.927494 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.927545 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:57.927786 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.928466 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.930007 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.930671 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.930729 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.930778 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.930969 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.931019 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":86,"threads_started":1}
I20260808 14:35:57.931782 25355 tablet_service.cc:1467] Processing CreateTablet for tablet bf83703df46741ffa45985c8d4c95118 (DEFAULT_TABLE table=test-table [id=47bbb127d4ac4448894bd2ca2af9cbfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:57.931842 25498 tablet_service.cc:1467] Processing CreateTablet for tablet bf83703df46741ffa45985c8d4c95118 (DEFAULT_TABLE table=test-table [id=47bbb127d4ac4448894bd2ca2af9cbfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:57.932000 25738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.926736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:38903 (local address 127.0.0.1:51784)
0808 14:35:57.927277 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:57.927288 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:57.927376 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:57.927649 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:57.927650 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:57.927653 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:57.927703 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.927705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.928592 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.928593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.929920 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.929923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.930806 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.930807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.930859 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.930864 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:35:57.931861 (+ 997us) client_negotiation.cc:240] Negotiation successful
0808 14:35:57.931910 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"mutex_wait_us":32,"thread_start_us":90,"threads_started":1}
I20260808 14:35:57.932192 25498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf83703df46741ffa45985c8d4c95118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:57.932192 25355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf83703df46741ffa45985c8d4c95118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:57.933179 25645 tablet_service.cc:1467] Processing CreateTablet for tablet bf83703df46741ffa45985c8d4c95118 (DEFAULT_TABLE table=test-table [id=47bbb127d4ac4448894bd2ca2af9cbfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:57.933502 25645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf83703df46741ffa45985c8d4c95118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:57.935699 25742 tablet_bootstrap.cc:492] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: Bootstrap starting.
I20260808 14:35:57.935946 25743 tablet_bootstrap.cc:492] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0: Bootstrap starting.
I20260808 14:35:57.936180 25744 tablet_bootstrap.cc:492] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: Bootstrap starting.
I20260808 14:35:57.936697 25743 tablet_bootstrap.cc:654] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:57.936859 25744 tablet_bootstrap.cc:654] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:57.937315 25743 log.cc:824] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:57.937386 25744 log.cc:824] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:57.938084 25743 tablet_bootstrap.cc:492] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0: No bootstrap required, opened a new log
I20260808 14:35:57.938166 25742 tablet_bootstrap.cc:654] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:57.938171 25743 ts_tablet_manager.cc:1397] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:35:57.938198 25744 tablet_bootstrap.cc:492] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: No bootstrap required, opened a new log
I20260808 14:35:57.938254 25744 ts_tablet_manager.cc:1397] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:57.938772 25742 log.cc:824] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:57.939566 25742 tablet_bootstrap.cc:492] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: No bootstrap required, opened a new log
I20260808 14:35:57.939640 25742 ts_tablet_manager.cc:1397] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 14:35:57.939957 25743 raft_consensus.cc:348] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } }
I20260808 14:35:57.940125 25743 raft_consensus.cc:374] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:57.940171 25743 raft_consensus.cc:729] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2353c8ad7bd436989bb81feec238ad0, State: Initialized, Role: FOLLOWER
I20260808 14:35:57.940308 25743 consensus_queue.cc:260] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } }
I20260808 14:35:57.940637 25428 heartbeater.cc:503] Master 127.20.81.62:35491 was elected leader, sending a full tablet report...
I20260808 14:35:57.940737 25744 raft_consensus.cc:348] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } }
I20260808 14:35:57.940893 25744 raft_consensus.cc:374] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:57.940928 25744 raft_consensus.cc:729] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4d01e396a5643dda0dbe30c68dce5d5, State: Initialized, Role: FOLLOWER
I20260808 14:35:57.940954 25743 ts_tablet_manager.cc:1428] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:35:57.941040 25744 consensus_queue.cc:260] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } }
I20260808 14:35:57.941318 25744 ts_tablet_manager.cc:1428] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:35:57.941346 25723 heartbeater.cc:503] Master 127.20.81.62:35491 was elected leader, sending a full tablet report...
I20260808 14:35:57.941761 25742 raft_consensus.cc:348] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } }
I20260808 14:35:57.941951 25742 raft_consensus.cc:374] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:57.941999 25742 raft_consensus.cc:729] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bef116469f7a4ebcbea58b90f89b71bf, State: Initialized, Role: FOLLOWER
I20260808 14:35:57.942111 25742 consensus_queue.cc:260] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } }
I20260808 14:35:57.942374 25742 ts_tablet_manager.cc:1428] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:35:57.942425 25574 heartbeater.cc:503] Master 127.20.81.62:35491 was elected leader, sending a full tablet report...
I20260808 14:35:57.970858 25748 raft_consensus.cc:482] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:57.970997 25748 raft_consensus.cc:504] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } }
I20260808 14:35:57.971448 25748 leader_election.cc:288] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bef116469f7a4ebcbea58b90f89b71bf (127.20.81.2:43091), b4d01e396a5643dda0dbe30c68dce5d5 (127.20.81.3:38903)
I20260808 14:35:57.974589 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.971645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:43091 (local address 127.20.81.1:58755)
0808 14:35:57.971706 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:57.971719 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:57.971766 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:57.971958 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:57.971961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:57.971963 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:57.972041 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.972043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.972764 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.972765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.973725 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.973728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.974338 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.974339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.974435 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.974440 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:35:57.974502 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 14:35:57.974534 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:35:57.974638 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.971737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:58755 (local address 127.20.81.2:43091)
0808 14:35:57.971792 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.971794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.971806 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:35:57.971839 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.971840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.971852 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.971952 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:57.972127 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.972672 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.973799 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.974255 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.974313 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.974322 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.974510 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.974553 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:35:57.974743 25751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.971686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:38903 (local address 127.20.81.1:51721)
0808 14:35:57.971872 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:57.971880 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:57.971948 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:57.972106 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:57.972107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:57.972108 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:57.972180 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.972182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.972904 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.972906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.973882 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:57.973885 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.974462 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.974463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:57.974554 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.974557 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:57.974617 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:35:57.974656 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":131,"threads_started":1}
I20260808 14:35:57.974779 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.971773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:51721 (local address 127.20.81.3:38903)
0808 14:35:57.971832 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.971834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.971946 (+ 112us) server_negotiation.cc:407] Connection header received
0808 14:35:57.972010 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.972011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.972024 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.972100 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:57.972256 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.972818 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.973965 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.974364 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.974435 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.974446 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.974645 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.974693 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:35:57.974998 25520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf83703df46741ffa45985c8d4c95118" candidate_uuid: "b2353c8ad7bd436989bb81feec238ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bef116469f7a4ebcbea58b90f89b71bf" is_pre_election: true
I20260808 14:35:57.975157 25520 raft_consensus.cc:2454] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2353c8ad7bd436989bb81feec238ad0 in term 0.
I20260808 14:35:57.975112 25670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf83703df46741ffa45985c8d4c95118" candidate_uuid: "b2353c8ad7bd436989bb81feec238ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" is_pre_election: true
I20260808 14:35:57.975309 25670 raft_consensus.cc:2454] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2353c8ad7bd436989bb81feec238ad0 in term 0.
I20260808 14:35:57.975405 25309 leader_election.cc:302] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2353c8ad7bd436989bb81feec238ad0, bef116469f7a4ebcbea58b90f89b71bf; no voters:
I20260808 14:35:57.975545 25748 raft_consensus.cc:2781] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:57.975610 25748 raft_consensus.cc:482] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:57.975643 25748 raft_consensus.cc:3037] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:57.976392 25748 raft_consensus.cc:504] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } }
I20260808 14:35:57.976540 25748 leader_election.cc:288] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [CANDIDATE]: Term 1 election: Requested vote from peers bef116469f7a4ebcbea58b90f89b71bf (127.20.81.2:43091), b4d01e396a5643dda0dbe30c68dce5d5 (127.20.81.3:38903)
I20260808 14:35:57.976724 25520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf83703df46741ffa45985c8d4c95118" candidate_uuid: "b2353c8ad7bd436989bb81feec238ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bef116469f7a4ebcbea58b90f89b71bf"
I20260808 14:35:57.976752 25670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf83703df46741ffa45985c8d4c95118" candidate_uuid: "b2353c8ad7bd436989bb81feec238ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4d01e396a5643dda0dbe30c68dce5d5"
I20260808 14:35:57.976818 25670 raft_consensus.cc:3037] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:57.976815 25520 raft_consensus.cc:3037] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:57.977733 25670 raft_consensus.cc:2454] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2353c8ad7bd436989bb81feec238ad0 in term 1.
I20260808 14:35:57.977733 25520 raft_consensus.cc:2454] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2353c8ad7bd436989bb81feec238ad0 in term 1.
I20260808 14:35:57.977946 25307 leader_election.cc:302] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2353c8ad7bd436989bb81feec238ad0, b4d01e396a5643dda0dbe30c68dce5d5; no voters:
I20260808 14:35:57.978046 25748 raft_consensus.cc:2781] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:57.978196 25748 raft_consensus.cc:686] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [term 1 LEADER]: Becoming Leader. State: Replica: b2353c8ad7bd436989bb81feec238ad0, State: Running, Role: LEADER
I20260808 14:35:57.978302 25748 consensus_queue.cc:237] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } }
I20260808 14:35:57.979315 25221 catalog_manager.cc:5495] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2353c8ad7bd436989bb81feec238ad0 (127.20.81.1). New cstate: current_term: 1 leader_uuid: "b2353c8ad7bd436989bb81feec238ad0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2353c8ad7bd436989bb81feec238ad0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 } health_report { overall_health: UNKNOWN } } }
I20260808 14:35:57.989930 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:57.987395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50486 (local address 127.20.81.1:35909)
0808 14:35:57.987438 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:57.987441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:57.987449 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:35:57.987554 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:57.987555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:57.987576 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:57.987665 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:57.987787 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.988259 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.989112 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:57.989329 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:57.989408 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:57.989584 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:57.989691 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:57.989789 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:57.989814 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 14:35:57.989833 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 14:35:57.991418 25575 tablet.cc:2369] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:35:57.991732 25670 raft_consensus.cc:1261] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [term 1 FOLLOWER]: Refusing update from remote peer b2353c8ad7bd436989bb81feec238ad0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:57.991746 25520 raft_consensus.cc:1261] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [term 1 FOLLOWER]: Refusing update from remote peer b2353c8ad7bd436989bb81feec238ad0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:57.992082 25748 consensus_queue.cc:1035] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bef116469f7a4ebcbea58b90f89b71bf" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 43091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:57.992211 25752 consensus_queue.cc:1035] T bf83703df46741ffa45985c8d4c95118 P b2353c8ad7bd436989bb81feec238ad0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4d01e396a5643dda0dbe30c68dce5d5" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:57.994964 25756 mvcc.cc:205] Tried to move back new op lower bound from 7316274208731394048 to 7316274208679964672. Current Snapshot: MvccSnapshot[applied={T|T < 7316274208731394048}]
I20260808 14:35:57.997155 25221 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:57.997238 25221 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:57.998028 25221 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 797bd40036dd4cc2a2701457830e83db: Sending DeleteTablet for 3 replicas of tablet bf83703df46741ffa45985c8d4c95118
I20260808 14:35:57.998363 25645 tablet_service.cc:1514] Processing DeleteTablet for tablet bf83703df46741ffa45985c8d4c95118 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:57 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:51784
I20260808 14:35:57.998376 25498 tablet_service.cc:1514] Processing DeleteTablet for tablet bf83703df46741ffa45985c8d4c95118 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:57 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:42592
I20260808 14:35:57.998479 25355 tablet_service.cc:1514] Processing DeleteTablet for tablet bf83703df46741ffa45985c8d4c95118 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:57 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:50476
I20260808 14:35:57.998596 25766 tablet_replica.cc:330] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: stopping tablet replica
I20260808 14:35:57.998693 25766 raft_consensus.cc:2229] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:57.998798 25766 raft_consensus.cc:2258] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:57.998939 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 25290
I20260808 14:35:57.998965 25765 tablet_replica.cc:330] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: stopping tablet replica
I20260808 14:35:57.999737 25766 ts_tablet_manager.cc:1905] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:58.000370 25765 raft_consensus.cc:2229] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:58.000494 25765 raft_consensus.cc:2258] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:58.000991 25765 ts_tablet_manager.cc:1905] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:58.001734 25766 ts_tablet_manager.cc:1918] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:35:58.001866 25766 log.cc:1196] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/bf83703df46741ffa45985c8d4c95118
I20260808 14:35:58.002230 25766 ts_tablet_manager.cc:1939] T bf83703df46741ffa45985c8d4c95118 P bef116469f7a4ebcbea58b90f89b71bf: Deleting consensus metadata
I20260808 14:35:58.002758 25765 ts_tablet_manager.cc:1918] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:35:58.002739 25208 catalog_manager.cc:4841] TS bef116469f7a4ebcbea58b90f89b71bf (127.20.81.2:43091): tablet bf83703df46741ffa45985c8d4c95118 (table test-table [id=47bbb127d4ac4448894bd2ca2af9cbfa]) successfully deleted
I20260808 14:35:58.002825 25765 log.cc:1196] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/bf83703df46741ffa45985c8d4c95118
I20260808 14:35:58.003078 25765 ts_tablet_manager.cc:1939] T bf83703df46741ffa45985c8d4c95118 P b4d01e396a5643dda0dbe30c68dce5d5: Deleting consensus metadata
I20260808 14:35:58.003521 25206 catalog_manager.cc:4841] TS b4d01e396a5643dda0dbe30c68dce5d5 (127.20.81.3:38903): tablet bf83703df46741ffa45985c8d4c95118 (table test-table [id=47bbb127d4ac4448894bd2ca2af9cbfa]) successfully deleted
W20260808 14:35:58.006644 25205 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:35909 (error 108)
I20260808 14:35:58.007187 25738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.007063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35909 (local address 127.0.0.1:50498)
0808 14:35:58.007123 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.007159 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 14:35:58.007311 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 25433
W20260808 14:35:58.007337 25205 catalog_manager.cc:4584] TS b2353c8ad7bd436989bb81feec238ad0 (127.20.81.1:35909): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bf83703df46741ffa45985c8d4c95118: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35909: connect: Connection refused (error 111)
I20260808 14:35:58.013170 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 25579
I20260808 14:35:58.019908 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 25189
2026-08-08T14:35:58Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (1965 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T14:35:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:58Z Disabled control of system clock
I20260808 14:35:58.051434 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44917
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:35947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:44917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:35:58.133692 25772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:58.133925 25772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:58.133961 25772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:58.135071 25772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:58.135138 25772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:58.135162 25772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:58.135190 25772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:58.135222 25772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:58.136610 25772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:35947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:44917
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:58.136889 25772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:58.137181 25772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:58.142122 25780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:58.142122 25778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:58.142123 25777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:58.142262 25772 server_base.cc:1034] running on GCE node
I20260808 14:35:58.142584 25772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:58.142899 25772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:58.144106 25772 hybrid_clock.cc:648] HybridClock initialized: now 1786199758144082 us; error 38 us; skew 500 ppm
I20260808 14:35:58.146353 25772 webserver.cc:460] Webserver started at http://127.20.81.62:45631/ using document root <none> and password file <none>
I20260808 14:35:58.146661 25772 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:58.146715 25772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:58.146903 25772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:58.148068 25772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "ef7642ca284d4e809ced573e1a14d69b"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "d71648eaa9301c184e0bbb44d6e84f7e"
server_key_iv: "b7e26c28591b53f68f649f9ead0ad961"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.148450 25772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "ef7642ca284d4e809ced573e1a14d69b"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "d71648eaa9301c184e0bbb44d6e84f7e"
server_key_iv: "b7e26c28591b53f68f649f9ead0ad961"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.150123 25772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:58.151206 25787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.151471 25772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:58.151584 25772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "ef7642ca284d4e809ced573e1a14d69b"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "d71648eaa9301c184e0bbb44d6e84f7e"
server_key_iv: "b7e26c28591b53f68f649f9ead0ad961"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.151678 25772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:58.155364 25772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:58.155655 25772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:58.155807 25772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:58.159945 25772 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:44917
I20260808 14:35:58.159981 25842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:44917 every 8 connection(s)
I20260808 14:35:58.160334 25772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:58.161154 25843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:58.164072 25843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b: Bootstrap starting.
I20260808 14:35:58.164767 25843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:58.165086 25843 log.cc:824] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:58.165854 25843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b: No bootstrap required, opened a new log
I20260808 14:35:58.165849 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 25772
I20260808 14:35:58.165992 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:58.166188 20804 external_mini_cluster.cc:1428] Setting key fd3c62c0831a36326421916efcc26554
I20260808 14:35:58.168256 25843 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7642ca284d4e809ced573e1a14d69b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44917 } }
I20260808 14:35:58.168457 25843 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:58.168498 25843 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7642ca284d4e809ced573e1a14d69b, State: Initialized, Role: FOLLOWER
I20260808 14:35:58.168690 25843 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7642ca284d4e809ced573e1a14d69b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44917 } }
I20260808 14:35:58.168799 25843 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:58.168869 25843 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:58.168926 25843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:58.169751 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.166767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54678 (local address 127.20.81.62:44917)
0808 14:35:58.167017 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.167027 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.167063 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:35:58.168203 (+ 1140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.168214 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.168271 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.168434 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.169244 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.169249 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.169249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.169254 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.169302 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.169316 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.169393 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.169451 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.169515 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":89,"threads_started":1}
I20260808 14:35:58.170128 25843 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7642ca284d4e809ced573e1a14d69b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44917 } }
I20260808 14:35:58.170243 25843 leader_election.cc:302] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef7642ca284d4e809ced573e1a14d69b; no voters:
I20260808 14:35:58.170392 25843 leader_election.cc:288] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:58.170480 25849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:58.170678 25843 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:58.170729 25849 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [term 1 LEADER]: Becoming Leader. State: Replica: ef7642ca284d4e809ced573e1a14d69b, State: Running, Role: LEADER
I20260808 14:35:58.170825 25849 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7642ca284d4e809ced573e1a14d69b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44917 } }
I20260808 14:35:58.171188 25849 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef7642ca284d4e809ced573e1a14d69b. Latest consensus state: current_term: 1 leader_uuid: "ef7642ca284d4e809ced573e1a14d69b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7642ca284d4e809ced573e1a14d69b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44917 } } }
I20260808 14:35:58.171278 25849 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:58.171200 25851 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef7642ca284d4e809ced573e1a14d69b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7642ca284d4e809ced573e1a14d69b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44917 } } }
I20260808 14:35:58.171689 25851 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:58.171926 25856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:58.172497 25856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:58.174111 25856 catalog_manager.cc:1347] Generated new cluster ID: 6102e1075ffa420b94ee28124e63efb0
I20260808 14:35:58.174166 25856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:35:58.188249 25856 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:58.188441 25856 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:58.191648 25856 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b: Generated new TSK 0
I20260808 14:35:58.191811 25856 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:35:58.201131 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44917
--builtin_ntp_servers=127.20.81.20:35947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:35:58.285033 25869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:58.285229 25869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:58.285252 25869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:58.286393 25869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:58.286433 25869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:58.286459 25869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:35:58.287801 25869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:35947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:58.288043 25869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:58.288355 25869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:58.294163 25880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:58.294133 25877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:58.294130 25878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:58.294569 25869 server_base.cc:1034] running on GCE node
I20260808 14:35:58.294773 25869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:58.295037 25869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:58.296227 25869 hybrid_clock.cc:648] HybridClock initialized: now 1786199758296206 us; error 41 us; skew 500 ppm
I20260808 14:35:58.297724 25869 webserver.cc:460] Webserver started at http://127.20.81.1:38371/ using document root <none> and password file <none>
I20260808 14:35:58.297991 25869 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:58.298054 25869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:58.298188 25869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:58.299491 25869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "02bfe1cdbba2432d8b599d5f599e8a4e"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "1a28774ceaf522a7027ebd38f875252c"
server_key_iv: "3c5f9c2a63346e4dcfa6c0fcf8e7d658"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.299799 25869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "02bfe1cdbba2432d8b599d5f599e8a4e"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "1a28774ceaf522a7027ebd38f875252c"
server_key_iv: "3c5f9c2a63346e4dcfa6c0fcf8e7d658"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.301204 25869 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:35:58.301916 25886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.302124 25869 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:58.302197 25869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "02bfe1cdbba2432d8b599d5f599e8a4e"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "1a28774ceaf522a7027ebd38f875252c"
server_key_iv: "3c5f9c2a63346e4dcfa6c0fcf8e7d658"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.302251 25869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:58.305481 25869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:58.305742 25869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:58.305884 25869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:58.306100 25869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:58.306406 25869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:58.306463 25869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.306506 25869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:58.306526 25869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.312423 25869 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:36095
I20260808 14:35:58.312475 26008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:36095 every 8 connection(s)
I20260808 14:35:58.312812 25869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:35:58.315734 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.313568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:48333 (local address 127.20.81.62:44917)
0808 14:35:58.313634 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.313636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.313847 (+ 211us) server_negotiation.cc:407] Connection header received
0808 14:35:58.314324 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.314325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.314332 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.314390 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.315522 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.315523 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.315524 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.315528 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.315544 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.315548 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.315601 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.315665 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.315678 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:35:58.315934 26011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.313549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44917 (local address 127.20.81.1:48333)
0808 14:35:58.313743 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.313775 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:58.314229 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:58.314454 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:58.314459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:58.314468 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:58.315369 (+ 901us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:35:58.315369 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:58.315397 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:35:58.315425 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:58.315613 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:58.315616 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:58.315618 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:35:58.315671 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:35:58.315719 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":103,"threads_started":1}
I20260808 14:35:58.316531 26009 heartbeater.cc:347] Connected to a master server at 127.20.81.62:44917
I20260808 14:35:58.316701 26009 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:58.316789 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 25869
I20260808 14:35:58.316874 26009 heartbeater.cc:511] Master 127.20.81.62:44917 requested a full tablet report, sending...
I20260808 14:35:58.316903 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:58.317086 20804 external_mini_cluster.cc:1428] Setting key 30025d66c0df088d28549712d25f0f06
I20260808 14:35:58.317533 25805 ts_manager.cc:194] Registered new tserver with Master: 02bfe1cdbba2432d8b599d5f599e8a4e (127.20.81.1:36095)
I20260808 14:35:58.318363 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44917
--builtin_ntp_servers=127.20.81.20:35947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:35:58.403453 26012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:58.403646 26012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:58.403667 26012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:58.404798 26012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:58.404829 26012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:58.404855 26012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:35:58.406108 26012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:35947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:58.406286 26012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:58.406662 26012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:58.411588 26020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:58.411624 26021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:58.411595 26023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:58.411975 26012 server_base.cc:1034] running on GCE node
I20260808 14:35:58.412164 26012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:58.412420 26012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:58.413566 26012 hybrid_clock.cc:648] HybridClock initialized: now 1786199758413545 us; error 38 us; skew 500 ppm
I20260808 14:35:58.414852 26012 webserver.cc:460] Webserver started at http://127.20.81.2:37887/ using document root <none> and password file <none>
I20260808 14:35:58.415097 26012 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:58.415148 26012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:58.415315 26012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:58.416380 26012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "0b17446c26b24f1db08923f6849ee259"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "ea7c796634d91387274f56a7e1bc315c"
server_key_iv: "cb170da9346066842af0b1398991d5f9"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.416791 26012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "0b17446c26b24f1db08923f6849ee259"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "ea7c796634d91387274f56a7e1bc315c"
server_key_iv: "cb170da9346066842af0b1398991d5f9"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.418200 26012 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:58.418942 26029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.419118 26012 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:35:58.419226 26012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "0b17446c26b24f1db08923f6849ee259"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "ea7c796634d91387274f56a7e1bc315c"
server_key_iv: "cb170da9346066842af0b1398991d5f9"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.419303 26012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:58.422755 26012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:58.423040 26012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:58.423183 26012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:58.423408 26012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:58.423756 26012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:58.423813 26012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.423852 26012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:58.423882 26012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.429610 26012 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:39373
I20260808 14:35:58.429649 26155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:39373 every 8 connection(s)
I20260808 14:35:58.429983 26012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:35:58.433072 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.430733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:44855 (local address 127.20.81.62:44917)
0808 14:35:58.430801 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.430804 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.431010 (+ 206us) server_negotiation.cc:407] Connection header received
0808 14:35:58.431526 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.431527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.431535 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.431600 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.432799 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.432801 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.432801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.432806 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.432820 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.432825 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.432904 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.432984 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.432999 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:35:58.433264 26158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.430696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44917 (local address 127.20.81.2:44855)
0808 14:35:58.430885 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.430924 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:58.431410 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:58.431671 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:58.431675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:58.431684 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:58.432654 (+ 970us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:35:58.432655 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:58.432683 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:35:58.432712 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:58.432912 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:58.432919 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:58.432922 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:58.432996 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:35:58.433057 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":74,"threads_started":1}
I20260808 14:35:58.433561 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 26012
I20260808 14:35:58.433662 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:58.433864 20804 external_mini_cluster.cc:1428] Setting key c056534c1ef339ad0d657c8dcb961b76
I20260808 14:35:58.433892 26156 heartbeater.cc:347] Connected to a master server at 127.20.81.62:44917
I20260808 14:35:58.433988 26156 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:58.434135 26156 heartbeater.cc:511] Master 127.20.81.62:44917 requested a full tablet report, sending...
I20260808 14:35:58.434487 25804 ts_manager.cc:194] Registered new tserver with Master: 0b17446c26b24f1db08923f6849ee259 (127.20.81.2:39373)
I20260808 14:35:58.434916 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44917
--builtin_ntp_servers=127.20.81.20:35947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:35:58.518102 26160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:58.518293 26160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:58.518314 26160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:58.519393 26160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:58.519428 26160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:58.519452 26160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:35:58.520884 26160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:35947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:44917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:58.521070 26160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:58.521317 26160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:58.526441 26165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:58.526603 26160 server_base.cc:1034] running on GCE node
W20260808 14:35:58.526429 26166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:58.526459 26168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:58.526960 26160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:58.527220 26160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:58.528385 26160 hybrid_clock.cc:648] HybridClock initialized: now 1786199758528379 us; error 34 us; skew 500 ppm
I20260808 14:35:58.529633 26160 webserver.cc:460] Webserver started at http://127.20.81.3:41571/ using document root <none> and password file <none>
I20260808 14:35:58.529920 26160 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:58.529991 26160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:58.530140 26160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:58.531204 26160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "287a383e8675481089ef7a7471f187ef"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "87ba6e171f16582ceacb2b2606cbaf65"
server_key_iv: "4bf656180899465a2e0ddf0d3e03a460"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.531591 26160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "287a383e8675481089ef7a7471f187ef"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "87ba6e171f16582ceacb2b2606cbaf65"
server_key_iv: "4bf656180899465a2e0ddf0d3e03a460"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.533017 26160 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:35:58.533756 26174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.533926 26160 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:58.534016 26160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "287a383e8675481089ef7a7471f187ef"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "87ba6e171f16582ceacb2b2606cbaf65"
server_key_iv: "4bf656180899465a2e0ddf0d3e03a460"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.534098 26160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:58.537562 26160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:58.537837 26160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:58.537985 26160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:58.538211 26160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:58.538519 26160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:58.538573 26160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.538614 26160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:58.538640 26160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.544775 26160 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:38071
I20260808 14:35:58.544824 26292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:38071 every 8 connection(s)
I20260808 14:35:58.545231 26160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:58.548271 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.546021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:52705 (local address 127.20.81.62:44917)
0808 14:35:58.546096 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.546099 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.546344 (+ 245us) server_negotiation.cc:407] Connection header received
0808 14:35:58.546787 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.546788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.546794 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.546879 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.548015 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.548021 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.548021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.548026 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.548043 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.548048 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.548112 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.548198 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.548213 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:35:58.548484 26295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.546006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44917 (local address 127.20.81.3:52705)
0808 14:35:58.546228 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.546263 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:58.546701 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:58.546930 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:58.546933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:58.546947 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:58.547840 (+ 893us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:35:58.547841 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:58.547868 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:35:58.547897 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:58.548124 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:58.548128 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:58.548131 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:58.548191 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:35:58.548242 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":111,"threads_started":1}
I20260808 14:35:58.549032 26293 heartbeater.cc:347] Connected to a master server at 127.20.81.62:44917
I20260808 14:35:58.549134 26293 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:58.549252 26293 heartbeater.cc:511] Master 127.20.81.62:44917 requested a full tablet report, sending...
I20260808 14:35:58.549636 25804 ts_manager.cc:194] Registered new tserver with Master: 287a383e8675481089ef7a7471f187ef (127.20.81.3:38071)
I20260808 14:35:58.550204 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 26160
I20260808 14:35:58.550314 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:58.550525 20804 external_mini_cluster.cc:1428] Setting key ad90443d353c7206c0e1010c2ce1854f
I20260808 14:35:58.551426 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:35:58.554122 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.552916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54682 (local address 127.20.81.62:44917)
0808 14:35:58.552961 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.552963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.553146 (+ 183us) server_negotiation.cc:407] Connection header received
0808 14:35:58.553227 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.553228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.553233 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.553304 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.553866 (+ 562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.553868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.553868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.553872 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.553886 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.553891 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.553955 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.554047 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.554060 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:35:58.555716 25804 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:58.557411 25804 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:35:58.561204 26303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.559537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:38071 (local address 127.0.0.1:57972)
0808 14:35:58.559704 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.559741 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:58.559804 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:58.560239 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:58.560240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:58.560250 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:58.560783 (+ 533us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:35:58.560784 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:58.560801 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:35:58.560824 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:58.561035 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:58.561042 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:58.561045 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:35:58.561117 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:35:58.561133 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260808 14:35:58.561215 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.559655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57972 (local address 127.20.81.3:38071)
0808 14:35:58.560083 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.560087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.560097 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:35:58.560121 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.560123 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.560131 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.560452 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.560890 (+ 438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.560896 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.560896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.560900 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.560932 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.560952 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.561040 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.561125 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.561139 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":91,"threads_started":1}
I20260808 14:35:58.561488 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.559739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:39373 (local address 127.0.0.1:58832)
0808 14:35:58.559960 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.559970 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:58.560017 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:58.560636 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:58.560637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:58.560641 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:58.561061 (+ 420us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:35:58.561061 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:58.561069 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:35:58.561083 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:58.561351 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:58.561352 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:58.561353 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:35:58.561405 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:35:58.561420 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":70,"threads_started":1}
I20260808 14:35:58.561666 26309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.559940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58832 (local address 127.20.81.2:39373)
0808 14:35:58.560149 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.560153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.560164 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:35:58.560189 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.560192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.560201 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.560279 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.561191 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.561201 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.561201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.561206 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.561239 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.561262 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.561321 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.561416 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.561432 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":89,"threads_started":1}
I20260808 14:35:58.562268 26304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.559537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:36095 (local address 127.0.0.1:56852)
0808 14:35:58.559697 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.559740 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:58.559800 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:58.560177 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:58.560184 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:58.561057 (+ 873us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:58.561507 (+ 450us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:35:58.561507 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:58.561513 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:35:58.561526 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:58.562118 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:58.562120 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:58.562121 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:35:58.562182 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:35:58.562196 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"spinlock_wait_cycles":1280,"thread_start_us":100,"threads_started":1}
I20260808 14:35:58.562299 26308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.559841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56852 (local address 127.20.81.1:36095)
0808 14:35:58.560017 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.560022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.560034 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:35:58.560064 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.560067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.560076 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.560162 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.561959 (+ 1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.561969 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.561969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.561974 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.562008 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.562036 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.562103 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.562193 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.562209 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":106,"threads_started":1}
I20260808 14:35:58.562247 26224 tablet_service.cc:1467] Processing CreateTablet for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8 (DEFAULT_TABLE table=test-table [id=86f3e9e822154475ba9cb9089507bdec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:58.562397 26083 tablet_service.cc:1467] Processing CreateTablet for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8 (DEFAULT_TABLE table=test-table [id=86f3e9e822154475ba9cb9089507bdec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:58.562639 26224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:58.562819 26083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:58.565279 25937 tablet_service.cc:1467] Processing CreateTablet for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8 (DEFAULT_TABLE table=test-table [id=86f3e9e822154475ba9cb9089507bdec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:58.565411 26310 tablet_bootstrap.cc:492] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: Bootstrap starting.
I20260808 14:35:58.565614 25937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:58.565749 26311 tablet_bootstrap.cc:492] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: Bootstrap starting.
I20260808 14:35:58.566138 26310 tablet_bootstrap.cc:654] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:58.566403 26311 tablet_bootstrap.cc:654] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:58.566460 26310 log.cc:824] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:58.566709 26311 log.cc:824] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:58.567282 26310 tablet_bootstrap.cc:492] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: No bootstrap required, opened a new log
I20260808 14:35:58.567337 26310 ts_tablet_manager.cc:1397] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:35:58.567456 26311 tablet_bootstrap.cc:492] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: No bootstrap required, opened a new log
I20260808 14:35:58.567514 26311 ts_tablet_manager.cc:1397] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:35:58.568513 26314 tablet_bootstrap.cc:492] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e: Bootstrap starting.
I20260808 14:35:58.569207 26314 tablet_bootstrap.cc:654] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:58.569581 26314 log.cc:824] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:58.569881 26310 raft_consensus.cc:348] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } }
I20260808 14:35:58.570050 26310 raft_consensus.cc:374] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:58.570099 26310 raft_consensus.cc:729] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b17446c26b24f1db08923f6849ee259, State: Initialized, Role: FOLLOWER
I20260808 14:35:58.570050 26311 raft_consensus.cc:348] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } }
I20260808 14:35:58.570221 26311 raft_consensus.cc:374] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:58.570216 26310 consensus_queue.cc:260] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } }
I20260808 14:35:58.570271 26311 raft_consensus.cc:729] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 287a383e8675481089ef7a7471f187ef, State: Initialized, Role: FOLLOWER
I20260808 14:35:58.570428 26311 consensus_queue.cc:260] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } }
I20260808 14:35:58.570503 26310 ts_tablet_manager.cc:1428] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:35:58.570533 26156 heartbeater.cc:503] Master 127.20.81.62:44917 was elected leader, sending a full tablet report...
I20260808 14:35:58.570721 26311 ts_tablet_manager.cc:1428] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:35:58.570745 26293 heartbeater.cc:503] Master 127.20.81.62:44917 was elected leader, sending a full tablet report...
I20260808 14:35:58.570750 26314 tablet_bootstrap.cc:492] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e: No bootstrap required, opened a new log
I20260808 14:35:58.570886 26314 ts_tablet_manager.cc:1397] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:35:58.573215 26314 raft_consensus.cc:348] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } }
I20260808 14:35:58.573359 26314 raft_consensus.cc:374] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:58.573407 26314 raft_consensus.cc:729] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bfe1cdbba2432d8b599d5f599e8a4e, State: Initialized, Role: FOLLOWER
I20260808 14:35:58.573518 26314 consensus_queue.cc:260] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } }
I20260808 14:35:58.573770 26314 ts_tablet_manager.cc:1428] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260808 14:35:58.573853 26009 heartbeater.cc:503] Master 127.20.81.62:44917 was elected leader, sending a full tablet report...
I20260808 14:35:58.603587 26316 raft_consensus.cc:482] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:58.603734 26316 raft_consensus.cc:504] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } }
I20260808 14:35:58.604208 26316 leader_election.cc:288] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bfe1cdbba2432d8b599d5f599e8a4e (127.20.81.1:36095), 287a383e8675481089ef7a7471f187ef (127.20.81.3:38071)
I20260808 14:35:58.605763 26158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.604393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:36095 (local address 127.20.81.2:46277)
0808 14:35:58.604459 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.604473 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:58.604515 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:58.604765 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:58.604766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:58.604769 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:58.605360 (+ 591us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:35:58.605361 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:58.605370 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:35:58.605387 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:58.605626 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:58.605627 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:58.605627 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 14:35:58.605680 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:35:58.605695 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 14:35:58.605798 26308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.604477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:46277 (local address 127.20.81.1:36095)
0808 14:35:58.604524 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.604526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.604646 (+ 120us) server_negotiation.cc:407] Connection header received
0808 14:35:58.604681 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.604682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.604687 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.604756 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.605493 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.605495 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.605495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.605499 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.605516 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.605537 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.605599 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.605690 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.605708 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:35:58.606019 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.604543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:60147 (local address 127.20.81.3:38071)
0808 14:35:58.604617 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.604620 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.604738 (+ 118us) server_negotiation.cc:407] Connection header received
0808 14:35:58.604817 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.604818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.604827 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.604910 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.605731 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.605732 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.605732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.605736 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.605749 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.605753 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.605785 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.605902 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.605917 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:35:58.606084 25959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a413d017ddf4b8b9aafb0cf4a9cb9b8" candidate_uuid: "0b17446c26b24f1db08923f6849ee259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" is_pre_election: true
I20260808 14:35:58.606215 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.604429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:38071 (local address 127.20.81.2:60147)
0808 14:35:58.604660 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.604669 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:58.604746 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:58.604947 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:58.604948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:58.604950 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:58.605580 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:35:58.605581 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:58.605588 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:35:58.605602 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:58.605829 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:58.605830 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:58.605830 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 14:35:58.606104 (+ 274us) client_negotiation.cc:240] Negotiation successful
0808 14:35:58.606119 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":105,"threads_started":1}
I20260808 14:35:58.606235 25959 raft_consensus.cc:2454] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b17446c26b24f1db08923f6849ee259 in term 0.
I20260808 14:35:58.606489 26031 leader_election.cc:302] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bfe1cdbba2432d8b599d5f599e8a4e, 0b17446c26b24f1db08923f6849ee259; no voters:
I20260808 14:35:58.606621 26316 raft_consensus.cc:2781] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:58.606706 26316 raft_consensus.cc:482] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:58.606739 26316 raft_consensus.cc:3037] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:58.606799 26245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a413d017ddf4b8b9aafb0cf4a9cb9b8" candidate_uuid: "0b17446c26b24f1db08923f6849ee259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "287a383e8675481089ef7a7471f187ef" is_pre_election: true
I20260808 14:35:58.606976 26245 raft_consensus.cc:2454] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b17446c26b24f1db08923f6849ee259 in term 0.
I20260808 14:35:58.607663 26316 raft_consensus.cc:504] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } }
I20260808 14:35:58.607807 26316 leader_election.cc:288] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [CANDIDATE]: Term 1 election: Requested vote from peers 02bfe1cdbba2432d8b599d5f599e8a4e (127.20.81.1:36095), 287a383e8675481089ef7a7471f187ef (127.20.81.3:38071)
I20260808 14:35:58.608021 25959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a413d017ddf4b8b9aafb0cf4a9cb9b8" candidate_uuid: "0b17446c26b24f1db08923f6849ee259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e"
I20260808 14:35:58.608125 25959 raft_consensus.cc:3037] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:58.608901 25959 raft_consensus.cc:2454] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b17446c26b24f1db08923f6849ee259 in term 1.
I20260808 14:35:58.609041 26245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a413d017ddf4b8b9aafb0cf4a9cb9b8" candidate_uuid: "0b17446c26b24f1db08923f6849ee259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "287a383e8675481089ef7a7471f187ef"
I20260808 14:35:58.609093 26031 leader_election.cc:302] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bfe1cdbba2432d8b599d5f599e8a4e, 0b17446c26b24f1db08923f6849ee259; no voters:
I20260808 14:35:58.609125 26245 raft_consensus.cc:3037] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:58.609175 26316 raft_consensus.cc:2781] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:58.609365 26316 raft_consensus.cc:686] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 1 LEADER]: Becoming Leader. State: Replica: 0b17446c26b24f1db08923f6849ee259, State: Running, Role: LEADER
I20260808 14:35:58.609474 26316 consensus_queue.cc:237] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } }
I20260808 14:35:58.610102 26245 raft_consensus.cc:2454] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b17446c26b24f1db08923f6849ee259 in term 1.
I20260808 14:35:58.610333 25805 catalog_manager.cc:5495] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b17446c26b24f1db08923f6849ee259 (127.20.81.2). New cstate: current_term: 1 leader_uuid: "0b17446c26b24f1db08923f6849ee259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b17446c26b24f1db08923f6849ee259" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 } health_report { overall_health: UNKNOWN } } }
I20260808 14:35:58.620491 26309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.619581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58846 (local address 127.20.81.2:39373)
0808 14:35:58.619647 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.619649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.619658 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:35:58.619700 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.619701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.619713 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.619773 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.620337 (+ 564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.620338 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.620338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.620341 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.620352 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.620355 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.620400 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.620430 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.620441 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:35:58.622275 25959 raft_consensus.cc:1261] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [term 1 FOLLOWER]: Refusing update from remote peer 0b17446c26b24f1db08923f6849ee259: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:58.622304 26245 raft_consensus.cc:1261] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [term 1 FOLLOWER]: Refusing update from remote peer 0b17446c26b24f1db08923f6849ee259: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:58.622655 26323 consensus_queue.cc:1035] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bfe1cdbba2432d8b599d5f599e8a4e" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:58.622771 26316 consensus_queue.cc:1035] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "287a383e8675481089ef7a7471f187ef" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:58.625324 26327 mvcc.cc:205] Tried to move back new op lower bound from 7316274211314077696 to 7316274211265085440. Current Snapshot: MvccSnapshot[applied={T|T < 7316274211314077696}]
I20260808 14:35:58.625901 26328 mvcc.cc:205] Tried to move back new op lower bound from 7316274211314077696 to 7316274211265085440. Current Snapshot: MvccSnapshot[applied={T|T < 7316274211314077696}]
I20260808 14:35:58.627996 25805 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:58.628111 25805 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:58.628980 25805 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef7642ca284d4e809ced573e1a14d69b: Sending DeleteTablet for 3 replicas of tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8
I20260808 14:35:58.629308 25937 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:58 UTC) from {username='slave'} at 127.0.0.1:56852
I20260808 14:35:58.629369 26083 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:58 UTC) from {username='slave'} at 127.0.0.1:58832
I20260808 14:35:58.629586 26335 tablet_replica.cc:330] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e: stopping tablet replica
I20260808 14:35:58.629685 26335 raft_consensus.cc:2229] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:58.629693 26224 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:58 UTC) from {username='slave'} at 127.0.0.1:57972
I20260808 14:35:58.629794 26335 raft_consensus.cc:2258] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:58.630023 26336 tablet_replica.cc:330] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: stopping tablet replica
I20260808 14:35:58.630199 26337 tablet_replica.cc:330] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: stopping tablet replica
I20260808 14:35:58.630250 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 25869
I20260808 14:35:58.630251 26335 ts_tablet_manager.cc:1905] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 02bfe1cdbba2432d8b599d5f599e8a4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:58.630300 26337 raft_consensus.cc:2229] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:58.630401 26337 raft_consensus.cc:2258] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:58.631250 26337 ts_tablet_manager.cc:1905] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:58.633718 26337 ts_tablet_manager.cc:1918] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:35:58.633813 26337 log.cc:1196] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/5a413d017ddf4b8b9aafb0cf4a9cb9b8
I20260808 14:35:58.634179 26337 ts_tablet_manager.cc:1939] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 287a383e8675481089ef7a7471f187ef: Deleting consensus metadata
I20260808 14:35:58.639217 26336 raft_consensus.cc:2229] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:35:58.639384 26336 raft_consensus.cc:2258] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:58.640900 25790 catalog_manager.cc:4841] TS 287a383e8675481089ef7a7471f187ef (127.20.81.3:38071): tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8 (table test-table [id=86f3e9e822154475ba9cb9089507bdec]) successfully deleted
I20260808 14:35:58.641687 26336 ts_tablet_manager.cc:1905] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:58.643113 26336 ts_tablet_manager.cc:1918] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:35:58.643204 26336 log.cc:1196] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/5a413d017ddf4b8b9aafb0cf4a9cb9b8
I20260808 14:35:58.643468 26336 ts_tablet_manager.cc:1939] T 5a413d017ddf4b8b9aafb0cf4a9cb9b8 P 0b17446c26b24f1db08923f6849ee259: Deleting consensus metadata
I20260808 14:35:58.643899 25789 catalog_manager.cc:4841] TS 0b17446c26b24f1db08923f6849ee259 (127.20.81.2:39373): tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8 (table test-table [id=86f3e9e822154475ba9cb9089507bdec]) successfully deleted
W20260808 14:35:58.644786 25789 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:36095 (error 108)
I20260808 14:35:58.645061 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 26012
I20260808 14:35:58.645386 26304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.645260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:36095 (local address 127.0.0.1:56858)
0808 14:35:58.645308 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.645343 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:36095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 14:35:58.645519 25789 catalog_manager.cc:4584] TS 02bfe1cdbba2432d8b599d5f599e8a4e (127.20.81.1:36095): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5a413d017ddf4b8b9aafb0cf4a9cb9b8: Network error: Client connection negotiation failed: client connection to 127.20.81.1:36095: connect: Connection refused (error 111)
I20260808 14:35:58.650709 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 26160
I20260808 14:35:58.657423 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 25772
2026-08-08T14:35:58Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (636 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 14:35:58.678855 20804 mini_oidc.cc:152] Starting JWKS server
I20260808 14:35:58.680105 20804 webserver.cc:460] Webserver started at https://127.0.0.1:45475/ using document root <none> and password file <none>
I20260808 14:35:58.680231 20804 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:35:58.680415 20804 webserver.cc:460] Webserver started at http://127.0.0.1:40491/ using document root <none> and password file <none>
2026-08-08T14:35:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:58Z Disabled control of system clock
I20260808 14:35:58.689235 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:41969
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:34311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:41969
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45475/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/testchainca.cert with env {}
W20260808 14:35:58.770771 26345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:58.770979 26345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:58.771001 26345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:58.772182 26345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:58.772224 26345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:58.772238 26345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:58.772250 26345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:58.772262 26345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:35:58.772275 26345 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:35:58.772329 26345 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45475/jwks.json
I20260808 14:35:58.773914 26345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:41969
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:41969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45475/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:58.774180 26345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:58.774401 26345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:58.779282 26353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:58.779292 26351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:58.779305 26350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:58.779578 26345 server_base.cc:1034] running on GCE node
I20260808 14:35:58.779804 26345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:58.780085 26345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:58.781307 26345 hybrid_clock.cc:648] HybridClock initialized: now 1786199758781272 us; error 29 us; skew 500 ppm
I20260808 14:35:58.782578 26345 webserver.cc:460] Webserver started at http://127.20.81.62:37667/ using document root <none> and password file <none>
I20260808 14:35:58.782828 26345 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:58.782877 26345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:58.783028 26345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:58.784199 26345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "eb1cdda3c9c94b699be2b91e561bb0b4"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "8fe340fa0f1b2edbeca6be159493f6ba"
server_key_iv: "02b8c6990e05e6a4c409cd2b51e78df4"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.784634 26345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "eb1cdda3c9c94b699be2b91e561bb0b4"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "8fe340fa0f1b2edbeca6be159493f6ba"
server_key_iv: "02b8c6990e05e6a4c409cd2b51e78df4"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.785969 26345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:58.786713 26360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:58.786901 26345 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:35:58.787014 26345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "eb1cdda3c9c94b699be2b91e561bb0b4"
format_stamp: "Formatted at 2026-08-08 14:35:58 on dist-test-slave-8n49"
server_key: "8fe340fa0f1b2edbeca6be159493f6ba"
server_key_iv: "02b8c6990e05e6a4c409cd2b51e78df4"
server_key_version: "encryptionkey@0"
I20260808 14:35:58.787103 26345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:58.802057 26345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:58.802371 26345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:58.802537 26345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:58.806586 26345 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:41969
I20260808 14:35:58.806632 26418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:41969 every 8 connection(s)
I20260808 14:35:58.806988 26345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:58.808116 26419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:58.810515 26419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4: Bootstrap starting.
I20260808 14:35:58.811123 26419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:58.811439 26419 log.cc:824] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:58.812126 26419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4: No bootstrap required, opened a new log
I20260808 14:35:58.813609 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 26345
I20260808 14:35:58.813752 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:58.813966 20804 external_mini_cluster.cc:1428] Setting key a5c96ad0253104f1c68c943fbeb9dc90
I20260808 14:35:58.813936 26419 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1cdda3c9c94b699be2b91e561bb0b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41969 } }
I20260808 14:35:58.814117 26419 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:58.814177 26419 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb1cdda3c9c94b699be2b91e561bb0b4, State: Initialized, Role: FOLLOWER
I20260808 14:35:58.814330 26419 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1cdda3c9c94b699be2b91e561bb0b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41969 } }
I20260808 14:35:58.814410 26419 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:58.814442 26419 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:58.814498 26419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:58.815027 26419 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1cdda3c9c94b699be2b91e561bb0b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41969 } }
I20260808 14:35:58.815150 26419 leader_election.cc:302] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb1cdda3c9c94b699be2b91e561bb0b4; no voters:
I20260808 14:35:58.815341 26419 leader_election.cc:288] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:58.815371 26425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:58.815485 26425 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [term 1 LEADER]: Becoming Leader. State: Replica: eb1cdda3c9c94b699be2b91e561bb0b4, State: Running, Role: LEADER
I20260808 14:35:58.815569 26425 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1cdda3c9c94b699be2b91e561bb0b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41969 } }
I20260808 14:35:58.815625 26419 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:58.815886 26425 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb1cdda3c9c94b699be2b91e561bb0b4. Latest consensus state: current_term: 1 leader_uuid: "eb1cdda3c9c94b699be2b91e561bb0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1cdda3c9c94b699be2b91e561bb0b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41969 } } }
I20260808 14:35:58.815974 26425 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:58.815894 26427 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb1cdda3c9c94b699be2b91e561bb0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1cdda3c9c94b699be2b91e561bb0b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41969 } } }
I20260808 14:35:58.816143 26427 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:58.816196 26429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:58.816774 26429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:58.818483 26429 catalog_manager.cc:1347] Generated new cluster ID: 5ab0dc2bc7484302ba40ac0f99a8b21f
I20260808 14:35:58.818537 26429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:35:58.821655 26423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.814485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55796 (local address 127.20.81.62:41969)
0808 14:35:58.814698 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.814712 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.814770 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:35:58.814892 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.814897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.814962 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.815093 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:58.815337 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:58.817129 (+ 1792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:58.818254 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:58.818841 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:58.818957 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:58.820903 (+ 1946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:58.820908 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:58.820908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:58.821131 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:58.821173 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:58.821189 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:58.821262 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:58.821352 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 14:35:58.821432 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
I20260808 14:35:58.822604 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:35:58.839329 26429 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:58.840333 26429 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:58.845259 26429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb1cdda3c9c94b699be2b91e561bb0b4: Generated new TSK 0
I20260808 14:35:58.845449 26429 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:35:58.871188 26451 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 14:35:58.871331 26451 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:35:58.871560 26423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:58.855599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55804 (local address 127.20.81.62:41969)
0808 14:35:58.855662 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:58.855664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:58.855798 (+ 134us) server_negotiation.cc:407] Connection header received
0808 14:35:58.855878 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:58.855879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:58.855903 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:58.855990 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:35:58.856146 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:58.856952 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:58.857764 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:58.858104 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:58.858174 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:58.858365 (+ 191us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:35:58.871323 (+ 12958us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45475/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:35:58.871486 (+ 163us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55804: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45475/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 14:35:58.871622 26423 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55804: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45475/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 14:35:58.872128 26450 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:35:58.855485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41969 (local address 127.0.0.1:55804)
0808 14:35:58.855727 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:58.855737 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:58.855800 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:58.856020 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:58.856021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:58.856023 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:35:58.856073 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:58.856075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:58.857061 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:58.857062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:58.857679 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:58.857682 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:58.858193 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:58.858194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:58.858237 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:58.858256 (+ 19us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:35:58.871540 (+ 13284us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45475/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:35:58.871767 (+ 227us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.81.62:41969: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45475/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":135,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.20.81.62:41969: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45475/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 14:35:58.872704 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 26345
2026-08-08T14:35:58Z chronyd exiting
I20260808 14:35:58.912271 20804 test_util.cc:175] -----------------------------------------------
I20260808 14:35:58.912354 20804 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199735403457-20804-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (234 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 14:35:58.913383 20804 mini_oidc.cc:152] Starting JWKS server
I20260808 14:35:58.914052 20804 webserver.cc:460] Webserver started at https://127.0.0.1:38651/ using document root <none> and password file <none>
I20260808 14:35:58.914122 20804 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:35:58.914237 20804 webserver.cc:460] Webserver started at http://127.0.0.1:33367/ using document root <none> and password file <none>
2026-08-08T14:35:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:58Z Disabled control of system clock
I20260808 14:35:58.923002 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:37141
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:37523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:37141
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38651/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/testchainca.cert with env {}
W20260808 14:35:59.005950 26457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:59.006170 26457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:59.006196 26457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:59.007465 26457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:59.007506 26457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:59.007520 26457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:59.007534 26457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:59.007586 26457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:35:59.007616 26457 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:35:59.007644 26457 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38651/jwks.json
I20260808 14:35:59.009227 26457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:37141
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:37141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38651/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:59.009487 26457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:59.009732 26457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:59.014485 26465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:59.014570 26463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:59.014570 26462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:59.015136 26457 server_base.cc:1034] running on GCE node
I20260808 14:35:59.015398 26457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:59.015708 26457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:59.016860 26457 hybrid_clock.cc:648] HybridClock initialized: now 1786199759016832 us; error 45 us; skew 500 ppm
I20260808 14:35:59.018111 26457 webserver.cc:460] Webserver started at http://127.20.81.62:35685/ using document root <none> and password file <none>
I20260808 14:35:59.018355 26457 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:59.018424 26457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:59.018558 26457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:59.019630 26457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "d2e26cf3454548828df210b134187638"
format_stamp: "Formatted at 2026-08-08 14:35:59 on dist-test-slave-8n49"
server_key: "386961c27657b38c6462521e4b10de1f"
server_key_iv: "70b1246f811409c7ae975c643e720b9d"
server_key_version: "encryptionkey@0"
I20260808 14:35:59.020007 26457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "d2e26cf3454548828df210b134187638"
format_stamp: "Formatted at 2026-08-08 14:35:59 on dist-test-slave-8n49"
server_key: "386961c27657b38c6462521e4b10de1f"
server_key_iv: "70b1246f811409c7ae975c643e720b9d"
server_key_version: "encryptionkey@0"
I20260808 14:35:59.021435 26457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:35:59.022192 26471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:59.022377 26457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:35:59.022487 26457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "d2e26cf3454548828df210b134187638"
format_stamp: "Formatted at 2026-08-08 14:35:59 on dist-test-slave-8n49"
server_key: "386961c27657b38c6462521e4b10de1f"
server_key_iv: "70b1246f811409c7ae975c643e720b9d"
server_key_version: "encryptionkey@0"
I20260808 14:35:59.022564 26457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:59.039835 26457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:59.040179 26457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:59.040344 26457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:59.044539 26457 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:37141
I20260808 14:35:59.044597 26529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:37141 every 8 connection(s)
I20260808 14:35:59.045117 26457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:59.047129 26530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:59.047709 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 26457
I20260808 14:35:59.047842 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:59.048062 20804 external_mini_cluster.cc:1428] Setting key 12434be85c7d99a64e487834613af435
I20260808 14:35:59.050552 26530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638: Bootstrap starting.
I20260808 14:35:59.051276 26530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:59.051599 26530 log.cc:824] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:59.052380 26530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638: No bootstrap required, opened a new log
I20260808 14:35:59.054351 26533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:59.048732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51790 (local address 127.20.81.62:37141)
0808 14:35:59.048959 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:59.048968 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:59.049004 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:35:59.049580 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:59.049589 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:59.049673 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:59.049830 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:59.050009 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.051371 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.052193 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.052828 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.052961 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:59.053631 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:59.053643 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:59.053643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:59.053856 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:59.053899 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:59.053915 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:59.053982 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:59.054047 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:35:59.054130 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":90,"threads_started":1}
I20260808 14:35:59.054915 26530 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e26cf3454548828df210b134187638" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37141 } }
I20260808 14:35:59.055085 26530 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:59.055133 26530 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e26cf3454548828df210b134187638, State: Initialized, Role: FOLLOWER
I20260808 14:35:59.055261 26530 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e26cf3454548828df210b134187638" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37141 } }
I20260808 14:35:59.055351 26530 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:59.055394 26530 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:59.055442 26530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:59.055526 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:35:59.056046 26530 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e26cf3454548828df210b134187638" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37141 } }
I20260808 14:35:59.056174 26530 leader_election.cc:302] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2e26cf3454548828df210b134187638; no voters:
I20260808 14:35:59.056344 26530 leader_election.cc:288] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:59.056375 26535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:59.056623 26535 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [term 1 LEADER]: Becoming Leader. State: Replica: d2e26cf3454548828df210b134187638, State: Running, Role: LEADER
I20260808 14:35:59.056628 26530 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:59.056734 26535 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e26cf3454548828df210b134187638" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37141 } }
I20260808 14:35:59.057090 26536 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2e26cf3454548828df210b134187638" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e26cf3454548828df210b134187638" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37141 } } }
I20260808 14:35:59.057193 26536 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:59.057125 26538 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2e26cf3454548828df210b134187638. Latest consensus state: current_term: 1 leader_uuid: "d2e26cf3454548828df210b134187638" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e26cf3454548828df210b134187638" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37141 } } }
I20260808 14:35:59.057296 26538 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:59.057422 26543 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:59.060714 26543 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:59.062346 26543 catalog_manager.cc:1347] Generated new cluster ID: 235385f7a09b4727beeab3a7255ae858
I20260808 14:35:59.062412 26543 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:35:59.075937 26543 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:59.076516 26543 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:59.078939 26543 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2e26cf3454548828df210b134187638: Generated new TSK 0
I20260808 14:35:59.079140 26543 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:35:59.102523 26563 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 14:35:59.102633 26563 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:35:59.102952 26533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:59.088658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51796 (local address 127.20.81.62:37141)
0808 14:35:59.088719 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:59.088721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:59.088811 (+ 90us) server_negotiation.cc:407] Connection header received
0808 14:35:59.088884 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:59.088885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:59.088898 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:59.088978 (+ 80us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:35:59.089078 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.089871 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.090618 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.090935 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.091016 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:59.091155 (+ 139us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:35:59.102723 (+ 11568us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:35:59.102877 (+ 154us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51796: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 14:35:59.103029 26533 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51796: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 14:35:59.103036 26562 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:35:59.088549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:37141 (local address 127.0.0.1:51796)
0808 14:35:59.088738 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:59.088749 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:59.088813 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:59.088978 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:59.088979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:59.088980 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:35:59.089034 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:59.089035 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.089954 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.089954 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:59.090540 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:59.090542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.091025 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.091025 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:59.091067 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:59.091071 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:35:59.102850 (+ 11779us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:35:59.102942 (+ 92us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.81.62:37141: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":129,"threads_started":1}
I20260808 14:35:59.103511 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 26457
2026-08-08T14:35:59Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (231 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 14:35:59.145015 20804 mini_oidc.cc:152] Starting JWKS server
I20260808 14:35:59.146147 20804 webserver.cc:460] Webserver started at https://127.0.0.1:38339/ using document root <none> and password file <none>
I20260808 14:35:59.146214 20804 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:35:59.146397 20804 webserver.cc:460] Webserver started at http://127.0.0.1:37647/ using document root <none> and password file <none>
2026-08-08T14:35:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:59Z Disabled control of system clock
I20260808 14:35:59.156754 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40893
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:45163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:40893
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38339/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:35:59.238601 26569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:59.238834 26569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:59.238870 26569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:59.240025 26569 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:59.240090 26569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:59.240114 26569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:59.240140 26569 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:59.240166 26569 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:35:59.240196 26569 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:35:59.240226 26569 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38339/jwks.json
I20260808 14:35:59.241719 26569 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:45163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:40893
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38339/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:59.242012 26569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:59.242307 26569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:59.247221 26575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:59.247267 26577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:59.247231 26574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:59.247534 26569 server_base.cc:1034] running on GCE node
I20260808 14:35:59.247756 26569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:59.248003 26569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:59.249145 26569 hybrid_clock.cc:648] HybridClock initialized: now 1786199759249128 us; error 29 us; skew 500 ppm
I20260808 14:35:59.250435 26569 webserver.cc:460] Webserver started at http://127.20.81.62:46667/ using document root <none> and password file <none>
I20260808 14:35:59.250703 26569 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:59.250751 26569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:59.250917 26569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:59.252032 26569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23"
format_stamp: "Formatted at 2026-08-08 14:35:59 on dist-test-slave-8n49"
server_key: "3cc6cc30c470b1cdb2be9b59c339b0c2"
server_key_iv: "2d30f2ab4307cddbdfe6c529e62b0e74"
server_key_version: "encryptionkey@0"
I20260808 14:35:59.252429 26569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23"
format_stamp: "Formatted at 2026-08-08 14:35:59 on dist-test-slave-8n49"
server_key: "3cc6cc30c470b1cdb2be9b59c339b0c2"
server_key_iv: "2d30f2ab4307cddbdfe6c529e62b0e74"
server_key_version: "encryptionkey@0"
I20260808 14:35:59.253875 26569 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:59.254664 26583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:59.254866 26569 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:35:59.254973 26569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23"
format_stamp: "Formatted at 2026-08-08 14:35:59 on dist-test-slave-8n49"
server_key: "3cc6cc30c470b1cdb2be9b59c339b0c2"
server_key_iv: "2d30f2ab4307cddbdfe6c529e62b0e74"
server_key_version: "encryptionkey@0"
I20260808 14:35:59.255054 26569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:59.296257 26569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:59.296622 26569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:59.296784 26569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:59.300942 26569 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:40893
I20260808 14:35:59.300983 26638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:40893 every 8 connection(s)
I20260808 14:35:59.301343 26569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:59.301657 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 26569
I20260808 14:35:59.301774 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:59.301983 20804 external_mini_cluster.cc:1428] Setting key 16ece61aee5a9be79894b173e9139ae8
I20260808 14:35:59.302243 26639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:59.305792 26639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23: Bootstrap starting.
I20260808 14:35:59.306594 26639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:59.306964 26639 log.cc:824] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:59.307946 26639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23: No bootstrap required, opened a new log
I20260808 14:35:59.308450 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:59.302942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60662 (local address 127.20.81.62:40893)
0808 14:35:59.303156 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:59.303163 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:59.303187 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:35:59.303640 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:59.303647 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:59.303712 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:59.303826 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:59.304140 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.305084 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.306338 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.306786 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.306884 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:59.307634 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:59.307639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:59.307639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:59.307852 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:59.307895 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:59.307911 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:59.307996 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:59.308117 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 14:35:59.308221 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":94,"threads_started":1}
I20260808 14:35:59.309680 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:35:59.310491 26639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40893 } }
I20260808 14:35:59.310643 26639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:59.310664 26639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4809f72b5f3a4b3fa1526bccf7cbdd23, State: Initialized, Role: FOLLOWER
I20260808 14:35:59.310837 26639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40893 } }
I20260808 14:35:59.310921 26639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:59.310972 26639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:59.311023 26639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:59.311864 26639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40893 } }
I20260808 14:35:59.311995 26639 leader_election.cc:302] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4809f72b5f3a4b3fa1526bccf7cbdd23; no voters:
I20260808 14:35:59.312177 26639 leader_election.cc:288] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:59.312229 26644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:59.312428 26644 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [term 1 LEADER]: Becoming Leader. State: Replica: 4809f72b5f3a4b3fa1526bccf7cbdd23, State: Running, Role: LEADER
I20260808 14:35:59.312487 26639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:59.312527 26644 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40893 } }
I20260808 14:35:59.312944 26646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4809f72b5f3a4b3fa1526bccf7cbdd23. Latest consensus state: current_term: 1 leader_uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40893 } } }
I20260808 14:35:59.312943 26645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4809f72b5f3a4b3fa1526bccf7cbdd23" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40893 } } }
I20260808 14:35:59.313112 26645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:59.313102 26646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:59.313598 26653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:59.314136 26653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:59.315711 26653 catalog_manager.cc:1347] Generated new cluster ID: 1bcff167c54a4c6b82d3bd7f4bc40ad1
I20260808 14:35:59.315759 26653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:35:59.325026 26653 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:59.325569 26653 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:59.328884 26653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4809f72b5f3a4b3fa1526bccf7cbdd23: Generated new TSK 0
I20260808 14:35:59.329072 26653 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:35:59.343647 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:59.339622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60676 (local address 127.20.81.62:40893)
0808 14:35:59.339674 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:59.339676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:59.339764 (+ 88us) server_negotiation.cc:407] Connection header received
0808 14:35:59.339824 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:59.339825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:59.339839 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:59.339923 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:35:59.340060 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.340909 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.341815 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.342130 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.342205 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:59.342384 (+ 179us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:35:59.343403 (+ 1019us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38339/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:35:59.343562 (+ 159us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60676: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38339/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 14:35:59.343753 26668 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:35:59.339532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:40893 (local address 127.0.0.1:60676)
0808 14:35:59.339686 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:59.339697 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:59.339763 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:59.339936 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:59.339937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:59.339938 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:35:59.339989 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:59.339991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.341032 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.341033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:59.341717 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:59.341720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.342218 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.342219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:59.342267 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:59.342272 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:35:59.343515 (+ 1243us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38339/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:35:59.343629 (+ 114us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.81.62:40893: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38339/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":100,"threads_started":1}
I20260808 14:35:59.344002 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 26569
E20260808 14:35:59.357525 26669 webserver.cc:533] Webserver: sslize failed:
E20260808 14:35:59.357613 26669 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T14:35:59Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (241 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T14:35:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:59Z Disabled control of system clock
I20260808 14:35:59.394999 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:46205
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:41055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:46205
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/testchainca.cert with env {}
W20260808 14:35:59.475852 26674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:59.476104 26674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:59.476143 26674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:59.477358 26674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:59.477428 26674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:59.477451 26674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:59.477487 26674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:59.477520 26674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:35:59.477545 26674 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:35:59.477568 26674 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 14:35:59.479094 26674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:41055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:46205
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:46205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:35:59.479372 26674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:59.479597 26674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:59.484607 26683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:59.484607 26681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:59.484596 26680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:59.484841 26674 server_base.cc:1034] running on GCE node
I20260808 14:35:59.485083 26674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:59.485328 26674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:59.486497 26674 hybrid_clock.cc:648] HybridClock initialized: now 1786199759486468 us; error 54 us; skew 500 ppm
I20260808 14:35:59.487914 26674 webserver.cc:460] Webserver started at http://127.20.81.62:33583/ using document root <none> and password file <none>
I20260808 14:35:59.488200 26674 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:59.488252 26674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:59.488425 26674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:35:59.489564 26674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "3aa4f64e22a9486c9961b0cc4061c118"
format_stamp: "Formatted at 2026-08-08 14:35:59 on dist-test-slave-8n49"
server_key: "3e2697d6e957c35864583276a2503257"
server_key_iv: "2719460254af7ef2ad088c8c084ee769"
server_key_version: "encryptionkey@0"
I20260808 14:35:59.489924 26674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "3aa4f64e22a9486c9961b0cc4061c118"
format_stamp: "Formatted at 2026-08-08 14:35:59 on dist-test-slave-8n49"
server_key: "3e2697d6e957c35864583276a2503257"
server_key_iv: "2719460254af7ef2ad088c8c084ee769"
server_key_version: "encryptionkey@0"
I20260808 14:35:59.491233 26674 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:35:59.492022 26689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:59.492197 26674 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:35:59.492308 26674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "3aa4f64e22a9486c9961b0cc4061c118"
format_stamp: "Formatted at 2026-08-08 14:35:59 on dist-test-slave-8n49"
server_key: "3e2697d6e957c35864583276a2503257"
server_key_iv: "2719460254af7ef2ad088c8c084ee769"
server_key_version: "encryptionkey@0"
I20260808 14:35:59.492431 26674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:59.516804 26674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:59.517143 26674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:59.517307 26674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:59.521476 26674 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:46205
I20260808 14:35:59.521519 26748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:46205 every 8 connection(s)
I20260808 14:35:59.521906 26674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:59.522893 26749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:59.525305 26749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118: Bootstrap starting.
I20260808 14:35:59.525869 26749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:59.526111 26749 log.cc:824] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:59.526790 26749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118: No bootstrap required, opened a new log
I20260808 14:35:59.528383 26749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa4f64e22a9486c9961b0cc4061c118" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46205 } }
I20260808 14:35:59.528533 26749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:59.528620 26749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aa4f64e22a9486c9961b0cc4061c118, State: Initialized, Role: FOLLOWER
I20260808 14:35:59.528766 26749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa4f64e22a9486c9961b0cc4061c118" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46205 } }
I20260808 14:35:59.528847 26749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:59.528870 26749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:59.528898 26749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:59.529387 26749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa4f64e22a9486c9961b0cc4061c118" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46205 } }
I20260808 14:35:59.529470 26749 leader_election.cc:302] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3aa4f64e22a9486c9961b0cc4061c118; no voters:
I20260808 14:35:59.529631 26749 leader_election.cc:288] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:59.529662 26753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:59.529773 26753 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [term 1 LEADER]: Becoming Leader. State: Replica: 3aa4f64e22a9486c9961b0cc4061c118, State: Running, Role: LEADER
I20260808 14:35:59.529794 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 26674
I20260808 14:35:59.529865 26753 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa4f64e22a9486c9961b0cc4061c118" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46205 } }
I20260808 14:35:59.529906 26749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:59.529915 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:35:59.530103 20804 external_mini_cluster.cc:1428] Setting key 140cbdfcc37de9724e72185c887a187d
I20260808 14:35:59.530172 26753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3aa4f64e22a9486c9961b0cc4061c118. Latest consensus state: current_term: 1 leader_uuid: "3aa4f64e22a9486c9961b0cc4061c118" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa4f64e22a9486c9961b0cc4061c118" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46205 } } }
I20260808 14:35:59.530247 26753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:59.530216 26754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3aa4f64e22a9486c9961b0cc4061c118" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa4f64e22a9486c9961b0cc4061c118" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46205 } } }
I20260808 14:35:59.530426 26754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118 [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:59.530926 26758 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:59.531481 26758 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:59.533098 26758 catalog_manager.cc:1347] Generated new cluster ID: 2412c551ed094adca10b14943ae282b3
I20260808 14:35:59.533160 26758 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:35:59.536631 26764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:59.530595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51276 (local address 127.20.81.62:46205)
0808 14:35:59.530839 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:59.530854 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:59.530881 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:35:59.530981 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:59.531009 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:59.531101 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:59.531518 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:59.531630 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.533227 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.534315 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.534975 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.535117 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:59.535807 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:59.535811 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:59.535811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:35:59.536034 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:59.536076 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:35:59.536092 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:59.536168 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:59.536295 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 14:35:59.536382 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":97,"threads_started":1}
I20260808 14:35:59.537668 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:35:59.545639 26758 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:59.546146 26758 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:59.551450 26758 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3aa4f64e22a9486c9961b0cc4061c118: Generated new TSK 0
I20260808 14:35:59.551648 26758 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:36:00.043593 26764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:59.561660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.20.81.62:46205)
0808 14:35:59.561731 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:59.561734 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:59.561845 (+ 111us) server_negotiation.cc:407] Connection header received
0808 14:35:59.561932 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:59.561933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:59.561956 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:59.562054 (+ 98us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:35:59.562196 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.562708 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.563513 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.563744 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.563821 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:59.564010 (+ 189us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:36:00.043254 (+479244us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:36:00.043492 (+ 238us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51278: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 14:36:00.043686 26764 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51278: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 14:36:00.043696 26779 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:35:59.561590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46205 (local address 127.0.0.1:51278)
0808 14:35:59.561776 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:59.561786 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:59.561865 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:59.562052 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:59.562054 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:59.562056 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:35:59.562117 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:59.562119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.562795 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.562796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:59.563402 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:59.563404 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:59.563826 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:59.563827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:59.563888 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:59.563893 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:36:00.043445 (+479552us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:36:00.043578 (+ 133us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.81.62:46205: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":106,"threads_started":1}
I20260808 14:36:00.043947 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 26674
2026-08-08T14:36:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (678 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (92 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (90 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:00 dist-test-slave-8n49 krb5kdc[26792](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:00 dist-test-slave-8n49 krb5kdc[26792](info): set up 2 sockets
Aug 08 14:36:00 dist-test-slave-8n49 krb5kdc[26792](info): commencing operation
krb5kdc: starting...
W20260808 14:36:01.300819 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:36:01 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:36:01.423519 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:42499
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:42499
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:01.504751 26806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:01.504961 26806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:01.504982 26806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:01.506146 26806 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:01.506188 26806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:01.506202 26806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:01.506214 26806 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:01.506227 26806 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:01.507687 26806 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:42499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:42499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:01.507954 26806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:01.508177 26806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:01.513011 26811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:01.513144 26806 server_base.cc:1034] running on GCE node
W20260808 14:36:01.513109 26815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:01.513082 26812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:01.513504 26806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:01.513785 26806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:01.514957 26806 hybrid_clock.cc:648] HybridClock initialized: now 1786199761514940 us; error 40 us; skew 500 ppm
Aug 08 14:36:01 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199761, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:01.517405 26806 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:36:01.517844 26806 webserver.cc:460] Webserver started at http://127.20.81.62:34035/ using document root <none> and password file <none>
I20260808 14:36:01.518092 26806 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:01.518139 26806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:01.518276 26806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:01.519344 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "735ddc928f25455a9716572073e1e2e0"
format_stamp: "Formatted at 2026-08-08 14:36:01 on dist-test-slave-8n49"
server_key: "0fde0ce34c82acb72399c9dd77dcfb04"
server_key_iv: "e12227bcf7e1346afe49336da2e59f36"
server_key_version: "encryptionkey@0"
I20260808 14:36:01.519706 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "735ddc928f25455a9716572073e1e2e0"
format_stamp: "Formatted at 2026-08-08 14:36:01 on dist-test-slave-8n49"
server_key: "0fde0ce34c82acb72399c9dd77dcfb04"
server_key_iv: "e12227bcf7e1346afe49336da2e59f36"
server_key_version: "encryptionkey@0"
I20260808 14:36:01.521097 26806 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:36:01.521818 26824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:01.522004 26806 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:01.522090 26806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "735ddc928f25455a9716572073e1e2e0"
format_stamp: "Formatted at 2026-08-08 14:36:01 on dist-test-slave-8n49"
server_key: "0fde0ce34c82acb72399c9dd77dcfb04"
server_key_iv: "e12227bcf7e1346afe49336da2e59f36"
server_key_version: "encryptionkey@0"
I20260808 14:36:01.522154 26806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:01.531108 26806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:01.533135 26806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:01.533247 26806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:01.537204 26806 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:42499
I20260808 14:36:01.537286 26880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:42499 every 8 connection(s)
I20260808 14:36:01.537612 26806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:01.538295 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 26806
I20260808 14:36:01.538378 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:36:01.538600 20804 external_mini_cluster.cc:1428] Setting key 25f426c966a8869d09b3e3f75df6d12e
I20260808 14:36:01.538614 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:01.541707 26881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0: Bootstrap starting.
I20260808 14:36:01.542316 26881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:01.542622 26881 log.cc:824] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:01.543313 26881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0: No bootstrap required, opened a new log
Aug 08 14:36:01 dist-test-slave-8n49 krb5kdc[26792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:01.545614 26881 raft_consensus.cc:348] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735ddc928f25455a9716572073e1e2e0" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 42499 } }
I20260808 14:36:01.545769 26881 raft_consensus.cc:374] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:01.545794 26881 raft_consensus.cc:729] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ddc928f25455a9716572073e1e2e0, State: Initialized, Role: FOLLOWER
I20260808 14:36:01.545943 26881 consensus_queue.cc:260] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735ddc928f25455a9716572073e1e2e0" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 42499 } }
I20260808 14:36:01.546033 26881 raft_consensus.cc:388] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:01.546077 26881 raft_consensus.cc:482] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:01.546164 26881 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:01.546988 26881 raft_consensus.cc:504] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735ddc928f25455a9716572073e1e2e0" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 42499 } }
I20260808 14:36:01.547109 26881 leader_election.cc:302] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 735ddc928f25455a9716572073e1e2e0; no voters:
I20260808 14:36:01.547288 26881 leader_election.cc:288] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:01.547356 26886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:01.547566 26886 raft_consensus.cc:686] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [term 1 LEADER]: Becoming Leader. State: Replica: 735ddc928f25455a9716572073e1e2e0, State: Running, Role: LEADER
I20260808 14:36:01.547564 26881 sys_catalog.cc:564] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:01.547717 26886 consensus_queue.cc:237] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735ddc928f25455a9716572073e1e2e0" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 42499 } }
I20260808 14:36:01.548105 26887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "735ddc928f25455a9716572073e1e2e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735ddc928f25455a9716572073e1e2e0" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 42499 } } }
I20260808 14:36:01.548184 26887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:01.548416 26888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 735ddc928f25455a9716572073e1e2e0. Latest consensus state: current_term: 1 leader_uuid: "735ddc928f25455a9716572073e1e2e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735ddc928f25455a9716572073e1e2e0" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 42499 } } }
I20260808 14:36:01.548744 26888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:01.548887 26893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:01.549542 26893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:01.549875 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:01.539131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39800 (local address 127.20.81.62:42499)
0808 14:36:01.539334 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:01.539342 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:01.539367 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:36:01.539773 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:01.539780 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:01.539832 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:01.539982 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:01.540658 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.541541 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.542362 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.542850 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.542968 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:01.545658 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:01.545662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:01.545662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:01.545672 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:01.547737 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:01.548187 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:01.548191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:01.548191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:01.548316 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:01.548570 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:01.548571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:01.548572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:01.548901 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:01.549067 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:01.549485 (+ 418us) server_negotiation.cc:299] Negotiation successful
0808 14:36:01.549629 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":102,"threads_started":1}
I20260808 14:36:01.551148 26893 catalog_manager.cc:1347] Generated new cluster ID: 935839870ef94a439a74a71ea3b7319c
I20260808 14:36:01.551204 26893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:01.574206 26893 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:01.574972 26893 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:01.581019 26893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 735ddc928f25455a9716572073e1e2e0: Generated new TSK 0
I20260808 14:36:01.581208 26893 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:36:01.610105 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:42499
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:01.694311 26911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:01.694727 26911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:01.694770 26911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:01.696034 26911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:01.696098 26911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:01.696146 26911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:36:01.697768 26911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:42499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:01.698050 26911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:01.698285 26911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:01.703336 26917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:01.703477 26911 server_base.cc:1034] running on GCE node
W20260808 14:36:01.703337 26916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:01.703395 26919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:01.703821 26911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:01.704044 26911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:01.705205 26911 hybrid_clock.cc:648] HybridClock initialized: now 1786199761705191 us; error 29 us; skew 500 ppm
Aug 08 14:36:01 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199761, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:01.707842 26911 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:36:01.708238 26911 webserver.cc:460] Webserver started at http://127.20.81.1:46629/ using document root <none> and password file <none>
I20260808 14:36:01.708442 26911 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:01.708484 26911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:01.708631 26911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:01.709650 26911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "358fb602cd0f4c0eb43ea9823ff81144"
format_stamp: "Formatted at 2026-08-08 14:36:01 on dist-test-slave-8n49"
server_key: "29a6524513c643580bd67a691fb94ecd"
server_key_iv: "d3fdc7eae429cc19758bdaf63f1d54a9"
server_key_version: "encryptionkey@0"
I20260808 14:36:01.709965 26911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "358fb602cd0f4c0eb43ea9823ff81144"
format_stamp: "Formatted at 2026-08-08 14:36:01 on dist-test-slave-8n49"
server_key: "29a6524513c643580bd67a691fb94ecd"
server_key_iv: "d3fdc7eae429cc19758bdaf63f1d54a9"
server_key_version: "encryptionkey@0"
I20260808 14:36:01.711251 26911 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:36:01.711946 26926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:01.712139 26911 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:01.712255 26911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "358fb602cd0f4c0eb43ea9823ff81144"
format_stamp: "Formatted at 2026-08-08 14:36:01 on dist-test-slave-8n49"
server_key: "29a6524513c643580bd67a691fb94ecd"
server_key_iv: "d3fdc7eae429cc19758bdaf63f1d54a9"
server_key_version: "encryptionkey@0"
I20260808 14:36:01.712332 26911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:01.728205 26911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:01.730228 26911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:01.730391 26911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:01.730613 26911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:01.730918 26911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:01.730978 26911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:01.731021 26911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:01.731057 26911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:01.736657 26911 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:40609
I20260808 14:36:01.736698 27046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:40609 every 8 connection(s)
I20260808 14:36:01.737046 26911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:36:01 dist-test-slave-8n49 krb5kdc[26792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199761, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:01.746229 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 26911
I20260808 14:36:01.746366 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:36:01.746531 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:01.737829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:43201 (local address 127.20.81.62:42499)
0808 14:36:01.737879 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:01.737881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:01.738090 (+ 209us) server_negotiation.cc:407] Connection header received
0808 14:36:01.739015 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:01.739016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:01.739027 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:01.739087 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:01.739752 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.740259 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.741290 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.741510 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.741578 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:01.743723 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:01.743724 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:01.743725 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:01.743732 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:01.745098 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:01.745542 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:01.745543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:01.745543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:01.745607 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:01.745864 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:01.745865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:01.745865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:01.745986 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:01.746057 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:01.746336 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 14:36:01.746425 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:36:01.746611 20804 external_mini_cluster.cc:1428] Setting key 038c786f39ec697221fc5043359364e7
I20260808 14:36:01.746731 27049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:01.737774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:42499 (local address 127.20.81.1:43201)
0808 14:36:01.737957 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:01.737999 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:01.738907 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:01.739140 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:01.739144 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:01.739463 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:01.739647 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:01.739652 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.740351 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.740352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:01.741191 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:01.741194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.741595 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.741596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:01.741696 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:01.742204 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:01.742213 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:01.743614 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:01.745205 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:01.745213 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:01.745215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:01.745447 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:01.745676 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:01.745677 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:01.745677 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:01.745790 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:01.746062 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:01.746069 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:01.746207 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 14:36:01.746313 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:36:01.746470 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":92,"threads_started":1}
I20260808 14:36:01.747354 27047 heartbeater.cc:347] Connected to a master server at 127.20.81.62:42499
I20260808 14:36:01.747471 27047 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:01.747699 27047 heartbeater.cc:511] Master 127.20.81.62:42499 requested a full tablet report, sending...
I20260808 14:36:01.748307 26841 ts_manager.cc:194] Registered new tserver with Master: 358fb602cd0f4c0eb43ea9823ff81144 (127.20.81.1:40609)
I20260808 14:36:01.749166 26841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:43201
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:36:01.773089 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:42499
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:01.854415 27053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:01.854630 27053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:01.854655 27053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:01.855808 27053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:01.855852 27053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:01.855878 27053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:36:01.857409 27053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:42499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:01.857661 27053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:01.857897 27053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:01.862782 27062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:01.862782 27060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:01.863094 27053 server_base.cc:1034] running on GCE node
W20260808 14:36:01.862841 27059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:01.863353 27053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:01.863603 27053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:01.864761 27053 hybrid_clock.cc:648] HybridClock initialized: now 1786199761864760 us; error 42 us; skew 500 ppm
Aug 08 14:36:01 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199761, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:01.867202 27053 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:36:01.867672 27053 webserver.cc:460] Webserver started at http://127.20.81.2:35109/ using document root <none> and password file <none>
I20260808 14:36:01.867909 27053 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:01.867981 27053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:01.868126 27053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:01.869242 27053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "7dcddc72705343a59ec54b33168dd24f"
format_stamp: "Formatted at 2026-08-08 14:36:01 on dist-test-slave-8n49"
server_key: "ba2bd43f880700fb68745b2678296f86"
server_key_iv: "7f52d71e840229fe0533fd709ed06516"
server_key_version: "encryptionkey@0"
I20260808 14:36:01.869612 27053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "7dcddc72705343a59ec54b33168dd24f"
format_stamp: "Formatted at 2026-08-08 14:36:01 on dist-test-slave-8n49"
server_key: "ba2bd43f880700fb68745b2678296f86"
server_key_iv: "7f52d71e840229fe0533fd709ed06516"
server_key_version: "encryptionkey@0"
I20260808 14:36:01.870940 27053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:36:01.871660 27072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:01.871845 27053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:01.871948 27053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "7dcddc72705343a59ec54b33168dd24f"
format_stamp: "Formatted at 2026-08-08 14:36:01 on dist-test-slave-8n49"
server_key: "ba2bd43f880700fb68745b2678296f86"
server_key_iv: "7f52d71e840229fe0533fd709ed06516"
server_key_version: "encryptionkey@0"
I20260808 14:36:01.872018 27053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:01.887617 27053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:01.889617 27053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:01.889767 27053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:01.890004 27053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:01.890311 27053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:01.890363 27053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:01.890404 27053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:01.890434 27053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:01.896106 27053 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:40357
I20260808 14:36:01.896157 27193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:40357 every 8 connection(s)
I20260808 14:36:01.896457 27053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:01.897960 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 27053
I20260808 14:36:01.898093 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:01.898321 20804 external_mini_cluster.cc:1428] Setting key 9001fe15a22d2ad1425e710c520345ac
Aug 08 14:36:01 dist-test-slave-8n49 krb5kdc[26792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199761, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:01.906812 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:01.897164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:43329 (local address 127.20.81.62:42499)
0808 14:36:01.897207 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:01.897209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:01.897438 (+ 229us) server_negotiation.cc:407] Connection header received
0808 14:36:01.898704 (+ 1266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:01.898706 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:01.898718 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:01.898767 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:01.899503 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.900112 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.901357 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.901556 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.901640 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:01.903724 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:01.903725 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:01.903725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:01.903733 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:01.905431 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:01.905834 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:01.905835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:01.905836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:01.905900 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:01.906144 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:01.906145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:01.906145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:01.906294 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:01.906371 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:01.906615 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 14:36:01.906703 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:36:01.906847 27196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:01.897146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:42499 (local address 127.20.81.2:43329)
0808 14:36:01.897319 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:01.897353 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:01.898598 (+ 1245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:01.898852 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:01.898857 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:01.899130 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:01.899403 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:01.899409 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.900203 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.900204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:01.901265 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:01.901268 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:01.901652 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:01.901653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:01.901783 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:01.902265 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:01.902274 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:01.903630 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:01.905530 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:01.905536 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:01.905538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:01.905762 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:01.905978 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:01.905979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:01.905979 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:01.906078 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:01.906362 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:01.906367 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:01.906485 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 14:36:01.906571 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:36:01.906689 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":91,"threads_started":1}
I20260808 14:36:01.907657 27194 heartbeater.cc:347] Connected to a master server at 127.20.81.62:42499
I20260808 14:36:01.907753 27194 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:36:01.907975 27194 heartbeater.cc:511] Master 127.20.81.62:42499 requested a full tablet report, sending...
I20260808 14:36:01.908388 26841 ts_manager.cc:194] Registered new tserver with Master: 7dcddc72705343a59ec54b33168dd24f (127.20.81.2:40357)
I20260808 14:36:01.908800 26841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:43329
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:36:01.927498 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:42499
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:02.009294 27199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:02.009490 27199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:02.009512 27199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:02.010581 27199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:02.010614 27199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:02.010641 27199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:36:02.012127 27199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:42499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:02.012311 27199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:02.012504 27199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:02.017354 27204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:02.017511 27199 server_base.cc:1034] running on GCE node
W20260808 14:36:02.017343 27208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:02.017343 27206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:02.017822 27199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:02.018054 27199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:02.019217 27199 hybrid_clock.cc:648] HybridClock initialized: now 1786199762019208 us; error 33 us; skew 500 ppm
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:02.021826 27199 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:36:02.022287 27199 webserver.cc:460] Webserver started at http://127.20.81.3:42675/ using document root <none> and password file <none>
I20260808 14:36:02.022505 27199 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:02.022570 27199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:02.022715 27199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:02.023761 27199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "cb7c431f4c5b478aacd28dc5a549599d"
format_stamp: "Formatted at 2026-08-08 14:36:02 on dist-test-slave-8n49"
server_key: "1e1d2218e2b64db7c5cf2625fdb7aa94"
server_key_iv: "dbcc26caa363944412f38bab232c2138"
server_key_version: "encryptionkey@0"
I20260808 14:36:02.024119 27199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "cb7c431f4c5b478aacd28dc5a549599d"
format_stamp: "Formatted at 2026-08-08 14:36:02 on dist-test-slave-8n49"
server_key: "1e1d2218e2b64db7c5cf2625fdb7aa94"
server_key_iv: "dbcc26caa363944412f38bab232c2138"
server_key_version: "encryptionkey@0"
I20260808 14:36:02.025588 27199 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:36:02.026294 27215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:02.026456 27199 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:02.026552 27199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "cb7c431f4c5b478aacd28dc5a549599d"
format_stamp: "Formatted at 2026-08-08 14:36:02 on dist-test-slave-8n49"
server_key: "1e1d2218e2b64db7c5cf2625fdb7aa94"
server_key_iv: "dbcc26caa363944412f38bab232c2138"
server_key_version: "encryptionkey@0"
I20260808 14:36:02.026633 27199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:02.035385 27199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:02.037640 27199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:02.037801 27199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:02.038029 27199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:02.038347 27199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:02.038396 27199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:02.038430 27199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:02.038462 27199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:02.044317 27199 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:37591
I20260808 14:36:02.044353 27336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:37591 every 8 connection(s)
I20260808 14:36:02.044741 27199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:02.052644 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 27199
I20260808 14:36:02.052740 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:02.052951 20804 external_mini_cluster.cc:1428] Setting key 34370832c89c679defe50c0fd79d80be
I20260808 14:36:02.054420 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:02.045468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:40765 (local address 127.20.81.62:42499)
0808 14:36:02.045512 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:02.045514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:02.045698 (+ 184us) server_negotiation.cc:407] Connection header received
0808 14:36:02.046670 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:02.046672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:02.046686 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:02.046738 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:02.047368 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.047967 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.049112 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.049309 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.049391 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:02.051464 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:02.051465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:02.051466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:02.051474 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:02.053106 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:02.053528 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:02.053529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:02.053530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:02.053592 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:02.053866 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:02.053867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:02.053867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:02.054011 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:02.054070 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:02.054289 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 14:36:02.054355 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:36:02.054663 27340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:02.045434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:42499 (local address 127.20.81.3:40765)
0808 14:36:02.045575 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:02.045617 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:02.046553 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:02.046807 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:02.046811 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:02.047079 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:02.047269 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:02.047273 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.048057 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.048059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:02.049026 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:02.049029 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.049403 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.049404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:02.049535 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:02.050019 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:02.050030 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:02.051368 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:02.053187 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:02.053194 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:02.053197 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:02.053452 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:02.053666 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:02.053667 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:02.053668 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:02.053799 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:02.054074 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:02.054079 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:02.054194 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 14:36:02.054278 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 14:36:02.054396 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":69,"threads_started":1}
I20260808 14:36:02.055204 27338 heartbeater.cc:347] Connected to a master server at 127.20.81.62:42499
I20260808 14:36:02.055306 27338 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:02.055503 27338 heartbeater.cc:511] Master 127.20.81.62:42499 requested a full tablet report, sending...
I20260808 14:36:02.055866 26841 ts_manager.cc:194] Registered new tserver with Master: cb7c431f4c5b478aacd28dc5a549599d (127.20.81.3:37591)
I20260808 14:36:02.056243 26841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:40765
I20260808 14:36:02.064738 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/test-admin.keytab.
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:02.081593 20804 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 14:36:02.083184 27345 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:02.082473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37994 (local address 127.20.81.1:40609)
0808 14:36:02.082646 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:02.082651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:02.082661 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:02.082690 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:02.082692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:02.082706 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:02.082774 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:02.083099 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37994: BlockingRecv error: recv got EOF from 127.0.0.1:37994 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
W20260808 14:36:02.083278 20804 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:02.084236 20804 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:02.085129 20804 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:36:02.092859 27345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:02.085645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38006 (local address 127.20.81.1:40609)
0808 14:36:02.085703 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:02.085705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:02.085760 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:36:02.085845 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:02.085846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:02.085858 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:02.085924 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:02.086310 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.087055 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.087782 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.088109 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.088197 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:02.090226 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:02.090235 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:02.090236 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:02.090243 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:02.091632 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:02.091992 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:02.091995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:02.091995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:02.092053 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:02.092250 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:02.092251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:02.092251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:02.092386 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:02.092551 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:02.092661 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 14:36:02.092741 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 14:36:02.094592 27345 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:02.094021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38022 (local address 127.20.81.1:40609)
0808 14:36:02.094059 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:02.094067 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:02.094109 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:36:02.094149 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:02.094150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:02.094158 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:02.094201 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:02.094553 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38022: BlockingRecv error: recv got EOF from 127.0.0.1:38022 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:36:02.094664 20804 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:02.095537 20804 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:02.096318 20804 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:36:02.102620 27345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:02.096840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38032 (local address 127.20.81.1:40609)
0808 14:36:02.096890 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:02.096892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:02.096955 (+ 63us) server_negotiation.cc:407] Connection header received
0808 14:36:02.096993 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:02.096994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:02.097001 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:02.097045 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:02.097363 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.097838 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.098460 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.098646 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.098696 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:02.100690 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:02.100691 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:02.100692 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:02.100698 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:02.101802 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:02.102089 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:02.102090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:02.102090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:02.102137 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:02.102290 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:02.102290 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:02.102291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:02.102364 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:02.102426 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:02.102508 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:36:02.102564 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 14:36:02.104117 27345 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:02.103550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38038 (local address 127.20.81.1:40609)
0808 14:36:02.103582 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:02.103584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:02.103655 (+ 71us) server_negotiation.cc:407] Connection header received
0808 14:36:02.103726 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:02.103727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:02.103735 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:02.103798 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:02.104057 (+ 259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38038: BlockingRecv error: recv got EOF from 127.0.0.1:38038 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260808 14:36:02.104199 20804 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199735403457-20804-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:02.105142 20804 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:02.105981 20804 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[26792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:36:02.112280 27345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:02.106440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38040 (local address 127.20.81.1:40609)
0808 14:36:02.106483 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:02.106485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:02.106570 (+ 85us) server_negotiation.cc:407] Connection header received
0808 14:36:02.106643 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:02.106644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:02.106652 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:02.106695 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:02.107036 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.107480 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.108127 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:02.108316 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:02.108382 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:02.110254 (+ 1872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:02.110255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:02.110255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:02.110261 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:02.111434 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:02.111737 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:02.111738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:02.111738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:02.111788 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:02.111944 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:02.111944 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:02.111944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:02.112029 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:02.112098 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:02.112178 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:36:02.112228 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:36:02.112946 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 26911
I20260808 14:36:02.122763 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 27053
I20260808 14:36:02.129848 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 27199
I20260808 14:36:02.134680 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 26806
2026-08-08T14:36:02Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1907 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[27360](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[27360](info): set up 2 sockets
Aug 08 14:36:02 dist-test-slave-8n49 krb5kdc[27360](info): commencing operation
krb5kdc: starting...
W20260808 14:36:03.212117 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:36:03 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:03Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.62.keytab.
Entry for principal oryx/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.62.keytab.
I20260808 14:36:03.335892 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:41645
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.62.keytab
--principal=oryx/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:41645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:03.422327 27373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:03.422528 27373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:03.422550 27373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:03.423683 27373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:03.423725 27373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:03.423740 27373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:03.423753 27373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:03.423765 27373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:03.425258 27373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:41645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.62.keytab
--principal=oryx/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:41645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:03.425500 27373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:03.425740 27373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:03.430632 27379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:03.430785 27373 server_base.cc:1034] running on GCE node
W20260808 14:36:03.430676 27382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:03.430649 27380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:03.431114 27373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:03.431404 27373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:03.432611 27373 hybrid_clock.cc:648] HybridClock initialized: now 1786199763432587 us; error 32 us; skew 500 ppm
Aug 08 14:36:03 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:03.439034 27373 init.cc:377] Logged in from keytab as oryx/127.20.81.62@KRBTEST.COM (short username oryx)
I20260808 14:36:03.439504 27373 webserver.cc:460] Webserver started at http://127.20.81.62:37073/ using document root <none> and password file <none>
I20260808 14:36:03.439741 27373 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:03.439810 27373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:03.439958 27373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:03.441097 27373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "6ad6bbdae9114e269066d0d8315fcb63"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "8bf1fac92856679e889c6bb0f86798a6"
server_key_iv: "2c0139ce5dd51da90efb3b556edd41a3"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.441478 27373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "6ad6bbdae9114e269066d0d8315fcb63"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "8bf1fac92856679e889c6bb0f86798a6"
server_key_iv: "2c0139ce5dd51da90efb3b556edd41a3"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.442855 27373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:36:03.443682 27389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:03.443866 27373 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:03.443975 27373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "6ad6bbdae9114e269066d0d8315fcb63"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "8bf1fac92856679e889c6bb0f86798a6"
server_key_iv: "2c0139ce5dd51da90efb3b556edd41a3"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.444051 27373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:03.464162 27373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:03.466583 27373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:03.466753 27373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:03.471051 27373 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:41645
I20260808 14:36:03.471088 27446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:41645 every 8 connection(s)
I20260808 14:36:03.471558 27373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:03.472781 27447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:03.475173 27447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: Bootstrap starting.
I20260808 14:36:03.475796 27447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:03.476107 27447 log.cc:824] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:03.476977 27447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: No bootstrap required, opened a new log
I20260808 14:36:03.478777 27447 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } }
I20260808 14:36:03.478957 27447 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:03.479009 27447 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ad6bbdae9114e269066d0d8315fcb63, State: Initialized, Role: FOLLOWER
I20260808 14:36:03.479211 27447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } }
I20260808 14:36:03.479321 27447 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:03.479372 27447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:03.479429 27447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:03.480311 27447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } }
I20260808 14:36:03.480443 27447 leader_election.cc:302] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ad6bbdae9114e269066d0d8315fcb63; no voters:
I20260808 14:36:03.480659 27447 leader_election.cc:288] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:03.480684 27450 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:03.480845 27450 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 1 LEADER]: Becoming Leader. State: Replica: 6ad6bbdae9114e269066d0d8315fcb63, State: Running, Role: LEADER
I20260808 14:36:03.480948 27450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } }
I20260808 14:36:03.480983 27447 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:03.481243 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 27373
I20260808 14:36:03.481309 27451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } }
I20260808 14:36:03.481371 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:36:03.481395 27451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:03.481614 20804 external_mini_cluster.cc:1428] Setting key a1dbd0e3027c4db4a2b6419ad24db28c
I20260808 14:36:03.481705 27455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:03.482309 27455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:03.483078 27452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ad6bbdae9114e269066d0d8315fcb63. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } }
I20260808 14:36:03.483554 27452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:03.484478 27455 catalog_manager.cc:1347] Generated new cluster ID: 10bad0bf1b2043fb95d063a3b70eb8e2
I20260808 14:36:03.484544 27455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:36:03 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:03.492260 27455 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:03.492961 27455 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:03.496124 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:03.482297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55236 (local address 127.20.81.62:41645)
0808 14:36:03.484700 (+ 2403us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:03.484710 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:03.484760 (+ 50us) server_negotiation.cc:407] Connection header received
0808 14:36:03.484886 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:03.484894 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:03.484953 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:03.485104 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:03.485866 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.487464 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.488499 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.489214 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.489339 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:03.492276 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:03.492281 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:03.492281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:03.492295 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:03.494424 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:03.494810 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:03.494813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:03.494814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:03.494924 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:03.495125 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:03.495125 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:03.495126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:03.495410 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:03.495570 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:03.495682 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 14:36:03.495863 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2349,"thread_start_us":296,"threads_started":1}
I20260808 14:36:03.497350 27455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: Generated new TSK 0
I20260808 14:36:03.497509 27455 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab.
Entry for principal oryx/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab.
I20260808 14:36:03.527942 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41645
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab
--principal=oryx/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:03.628113 27474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:03.628322 27474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:03.628345 27474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:03.629572 27474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:03.629616 27474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:03.629644 27474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:36:03.631104 27474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab
--principal=oryx/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:03.631369 27474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:03.631599 27474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:03.637775 27479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:03.637768 27482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:03.637768 27480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:03.637795 27474 server_base.cc:1034] running on GCE node
I20260808 14:36:03.638255 27474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:03.638523 27474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:03.639678 27474 hybrid_clock.cc:648] HybridClock initialized: now 1786199763639666 us; error 28 us; skew 500 ppm
Aug 08 14:36:03 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:03.642408 27474 init.cc:377] Logged in from keytab as oryx/127.20.81.1@KRBTEST.COM (short username oryx)
I20260808 14:36:03.642834 27474 webserver.cc:460] Webserver started at http://127.20.81.1:33161/ using document root <none> and password file <none>
I20260808 14:36:03.643069 27474 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:03.643136 27474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:03.643290 27474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:03.644387 27474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "395a5392b7394c729a8614b18e333444"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "7d398c4e10425f71c9cd4ec1a3b9f768"
server_key_iv: "73dc66d0c82fb3a0167d7490df6f3e2f"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.644790 27474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "395a5392b7394c729a8614b18e333444"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "7d398c4e10425f71c9cd4ec1a3b9f768"
server_key_iv: "73dc66d0c82fb3a0167d7490df6f3e2f"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.646201 27474 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:03.647011 27490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:03.647240 27474 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:03.647352 27474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "395a5392b7394c729a8614b18e333444"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "7d398c4e10425f71c9cd4ec1a3b9f768"
server_key_iv: "73dc66d0c82fb3a0167d7490df6f3e2f"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.647439 27474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:03.656723 27474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:03.659016 27474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:03.659178 27474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:03.659411 27474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:03.659737 27474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:03.659798 27474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:03.659840 27474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:03.659879 27474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:03.665642 27474 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:44465
I20260808 14:36:03.665735 27614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:44465 every 8 connection(s)
I20260808 14:36:03.666045 27474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:36:03 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:03.673920 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 27474
I20260808 14:36:03.674007 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:36:03.674222 20804 external_mini_cluster.cc:1428] Setting key 5713a6643a68755be3e764eb8993dd42
I20260808 14:36:03.675915 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:03.666805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:56875 (local address 127.20.81.62:41645)
0808 14:36:03.666864 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:03.666866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:03.667055 (+ 189us) server_negotiation.cc:407] Connection header received
0808 14:36:03.667561 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:03.667562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:03.667572 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:03.667616 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:03.668693 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.669273 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.670402 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.670614 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.670686 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:03.672959 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:03.672960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:03.672960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:03.672966 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:03.674238 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:03.674754 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:03.674755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:03.674755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:03.674838 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:03.675119 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:03.675120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:03.675120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:03.675278 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:03.675350 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:03.675668 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 14:36:03.675775 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:36:03.676034 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:03.666761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.1:56875)
0808 14:36:03.666928 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:03.666972 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:03.667460 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:03.667672 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:03.667675 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:03.668271 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:03.668473 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:03.668478 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.669394 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.669395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:03.670296 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:03.670299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.670742 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.670744 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:03.670860 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:03.671426 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:03.671436 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:03.672841 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:03.674343 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:03.674351 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:03.674353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:03.674673 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:03.674909 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:03.674910 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:03.674911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:03.675042 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:03.675348 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:03.675354 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:03.675515 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 14:36:03.675619 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 14:36:03.675780 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260808 14:36:03.676713 27615 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41645
I20260808 14:36:03.676828 27615 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:03.677039 27615 heartbeater.cc:511] Master 127.20.81.62:41645 requested a full tablet report, sending...
I20260808 14:36:03.677584 27409 ts_manager.cc:194] Registered new tserver with Master: 395a5392b7394c729a8614b18e333444 (127.20.81.1:44465)
I20260808 14:36:03.678191 27409 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:56875
WARNING: no policy specified for oryx/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab.
Entry for principal oryx/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab.
I20260808 14:36:03.703447 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41645
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab
--principal=oryx/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:03.786595 27620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:03.786813 27620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:03.786851 27620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:03.788098 27620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:03.788156 27620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:03.788201 27620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:36:03.789644 27620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab
--principal=oryx/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:03.789896 27620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:03.790122 27620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:03.795248 27626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:03.795253 27628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:03.795261 27625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:03.795483 27620 server_base.cc:1034] running on GCE node
I20260808 14:36:03.795717 27620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:03.795964 27620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:03.797128 27620 hybrid_clock.cc:648] HybridClock initialized: now 1786199763797117 us; error 28 us; skew 500 ppm
Aug 08 14:36:03 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:03.799612 27620 init.cc:377] Logged in from keytab as oryx/127.20.81.2@KRBTEST.COM (short username oryx)
I20260808 14:36:03.800063 27620 webserver.cc:460] Webserver started at http://127.20.81.2:34297/ using document root <none> and password file <none>
I20260808 14:36:03.800297 27620 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:03.800367 27620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:03.800525 27620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:03.801673 27620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "3d96d6691b0e48d6b151abc4b0a4377b"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "0bc17a5dcbdfeaf0d811f99f00cd513a"
server_key_iv: "d8c3dc482fb3302426ba9ea8fffe8bb5"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.802064 27620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "3d96d6691b0e48d6b151abc4b0a4377b"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "0bc17a5dcbdfeaf0d811f99f00cd513a"
server_key_iv: "d8c3dc482fb3302426ba9ea8fffe8bb5"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.803493 27620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:36:03.804311 27635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:03.804509 27620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:36:03.804638 27620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "3d96d6691b0e48d6b151abc4b0a4377b"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "0bc17a5dcbdfeaf0d811f99f00cd513a"
server_key_iv: "d8c3dc482fb3302426ba9ea8fffe8bb5"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.804720 27620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:03.858145 27620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:03.860145 27620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:03.860322 27620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:03.860615 27620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:03.860965 27620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:03.861029 27620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:03.861076 27620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:03.861121 27620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:03.867331 27620 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:46085
I20260808 14:36:03.867377 27758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:46085 every 8 connection(s)
I20260808 14:36:03.867758 27620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:03.869120 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 27620
I20260808 14:36:03.869241 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:03.869483 20804 external_mini_cluster.cc:1428] Setting key 21eb5077e1f5c0daf23bd3b52ae77b10
Aug 08 14:36:03 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:03.878387 27761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:03.868504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.2:41947)
0808 14:36:03.868708 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:03.868746 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:03.869479 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:03.869766 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:03.869769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:03.870432 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:03.870708 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:03.870714 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.871426 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.871427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:03.872461 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:03.872464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.873031 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.873032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:03.873135 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:03.873652 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:03.873660 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:03.875035 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:03.877056 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:03.877065 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:03.877067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:03.877288 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:03.877521 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:03.877521 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:03.877521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:03.877613 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:03.877916 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:03.877920 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:03.878034 (+ 114us) client_negotiation.cc:769] Sending connection context
0808 14:36:03.878109 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:36:03.878224 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":130,"threads_started":1}
I20260808 14:36:03.878398 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:03.868544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:41947 (local address 127.20.81.62:41645)
0808 14:36:03.868638 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:03.868641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:03.868832 (+ 191us) server_negotiation.cc:407] Connection header received
0808 14:36:03.869602 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:03.869604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:03.869618 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:03.869709 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:03.870803 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.871336 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.872549 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:03.872917 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:03.873029 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:03.875131 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:03.875133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:03.875134 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:03.875143 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:03.876964 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:03.877365 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:03.877366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:03.877367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:03.877442 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:03.877679 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:03.877681 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:03.877681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:03.877839 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:03.877915 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:03.878168 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 14:36:03.878256 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:36:03.878969 27759 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41645
I20260808 14:36:03.879071 27759 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:03.879256 27759 heartbeater.cc:511] Master 127.20.81.62:41645 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:36:03.879693 27409 ts_manager.cc:194] Registered new tserver with Master: 3d96d6691b0e48d6b151abc4b0a4377b (127.20.81.2:46085)
I20260808 14:36:03.880075 27409 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:41947
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab.
Entry for principal oryx/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab.
I20260808 14:36:03.899487 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41645
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab
--principal=oryx/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:03.982686 27764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:03.982879 27764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:03.982903 27764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:03.984067 27764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:03.984108 27764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:03.984134 27764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:36:03.985643 27764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab
--principal=oryx/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:03.985884 27764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:03.986111 27764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:03.991164 27769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:03.991173 27770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:03.991204 27764 server_base.cc:1034] running on GCE node
W20260808 14:36:03.991173 27773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:03.991604 27764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:03.991856 27764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:03.993062 27764 hybrid_clock.cc:648] HybridClock initialized: now 1786199763993045 us; error 44 us; skew 500 ppm
Aug 08 14:36:03 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:03.995553 27764 init.cc:377] Logged in from keytab as oryx/127.20.81.3@KRBTEST.COM (short username oryx)
I20260808 14:36:03.996057 27764 webserver.cc:460] Webserver started at http://127.20.81.3:35589/ using document root <none> and password file <none>
I20260808 14:36:03.996304 27764 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:03.996369 27764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:03.996515 27764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:03.997663 27764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "e59bf41693764b15a8140b1e00166a82"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "38594b7c8bd56c2c76e0ea360ddc665f"
server_key_iv: "d8724749e663b2d4d6f4761bf54ab7b2"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.998107 27764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "e59bf41693764b15a8140b1e00166a82"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "38594b7c8bd56c2c76e0ea360ddc665f"
server_key_iv: "d8724749e663b2d4d6f4761bf54ab7b2"
server_key_version: "encryptionkey@0"
I20260808 14:36:03.999464 27764 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:36:04.000197 27780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.000399 27764 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:04.000533 27764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "e59bf41693764b15a8140b1e00166a82"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "38594b7c8bd56c2c76e0ea360ddc665f"
server_key_iv: "d8724749e663b2d4d6f4761bf54ab7b2"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.000635 27764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.026492 27764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:04.028749 27764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:04.028918 27764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:04.029166 27764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:04.029517 27764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:04.029572 27764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.029609 27764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:04.029637 27764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.035523 27764 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:44117
I20260808 14:36:04.035597 27901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:44117 every 8 connection(s)
I20260808 14:36:04.035925 27764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:04.044921 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 27764
I20260808 14:36:04.045045 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:04.045262 20804 external_mini_cluster.cc:1428] Setting key 12736156a1ff46065ccac01c27f64c75
I20260808 14:36:04.045401 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.036687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:58647 (local address 127.20.81.62:41645)
0808 14:36:04.036754 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.036757 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.036967 (+ 210us) server_negotiation.cc:407] Connection header received
0808 14:36:04.037480 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.037481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.037493 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.037549 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.038511 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.039040 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.040038 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.040252 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.040321 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.042554 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.042556 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.042556 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.042564 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.043831 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.044200 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.044201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.044201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.044253 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.044498 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.044500 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.044500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.044696 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.044765 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.045197 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.045280 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:36:04.045653 27904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.036690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.3:58647)
0808 14:36:04.036842 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.036877 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.037377 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.037630 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.037633 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.038203 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.038399 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.038404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.039135 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.039136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.039935 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.039937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.040361 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.040362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.040483 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.041088 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.041097 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.042459 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.043904 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.043910 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.043912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.044131 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.044309 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.044309 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.044310 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.044404 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.044797 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.044806 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.044983 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.045166 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.045357 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260808 14:36:04.046139 27902 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41645
I20260808 14:36:04.046260 27902 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:04.046451 27902 heartbeater.cc:511] Master 127.20.81.62:41645 requested a full tablet report, sending...
I20260808 14:36:04.046880 27408 ts_manager.cc:194] Registered new tserver with Master: e59bf41693764b15a8140b1e00166a82 (127.20.81.3:44117)
I20260808 14:36:04.047278 27408 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:58647
I20260808 14:36:04.057273 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.81.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.61.keytab.
Entry for principal oryx/127.20.81.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.61.keytab.
I20260808 14:36:04.084154 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.61:44229
--webserver_interface=127.20.81.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.61.keytab
--principal=oryx/127.20.81.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:41645,127.20.81.61:44229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:04.166368 27907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:04.166621 27907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:04.166657 27907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:04.167833 27907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:04.167908 27907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:04.167934 27907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:04.167961 27907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:04.167990 27907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:04.169497 27907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:41645,127.20.81.61:44229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.61.keytab
--principal=oryx/127.20.81.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.61:44229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.81.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
W20260808 14:36:04.169639 27907 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.20.81.62:41645,127.20.81.61:44229'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 14:36:04.169799 27907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:04.170017 27907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:04.174827 27916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.174839 27914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.174860 27913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:04.175093 27907 server_base.cc:1034] running on GCE node
I20260808 14:36:04.175328 27907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:04.175655 27907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:04.176792 27907 hybrid_clock.cc:648] HybridClock initialized: now 1786199764176772 us; error 35 us; skew 500 ppm
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:04.179294 27907 init.cc:377] Logged in from keytab as oryx/127.20.81.61@KRBTEST.COM (short username oryx)
I20260808 14:36:04.179778 27907 webserver.cc:460] Webserver started at http://127.20.81.61:35939/ using document root <none> and password file <none>
I20260808 14:36:04.179967 27907 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:04.180007 27907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:04.180099 27907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:04.181145 27907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data/instance:
uuid: "ecfbba2f18a84213bb37107d003e71cb"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "120a21f78ad8e5752216bf28f79f40af"
server_key_iv: "4778fdb42032a2b1beb57c6ab71b8680"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.181459 27907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal/instance:
uuid: "ecfbba2f18a84213bb37107d003e71cb"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "120a21f78ad8e5752216bf28f79f40af"
server_key_iv: "4778fdb42032a2b1beb57c6ab71b8680"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.182869 27907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:36:04.183564 27923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.183728 27907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:04.183817 27907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal
uuid: "ecfbba2f18a84213bb37107d003e71cb"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "120a21f78ad8e5752216bf28f79f40af"
server_key_iv: "4778fdb42032a2b1beb57c6ab71b8680"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.183887 27907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.191754 27907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:04.193637 27907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:04.193782 27907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:04.197670 27907 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.61:44229
I20260808 14:36:04.197700 27976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.61:44229 every 8 connection(s)
I20260808 14:36:04.198038 27907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
I20260808 14:36:04.199016 27977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:04.199020 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 27907
I20260808 14:36:04.201525 27977 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.81.61@KRBTEST.COM
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.61@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:04.209425 27980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.199641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54582 (local address 127.20.81.61:44229)
0808 14:36:04.199800 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.199809 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.199840 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:36:04.200226 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.200232 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.200275 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.200383 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.201206 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.202149 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.202890 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.203387 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.203508 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.205946 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.205953 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.205953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.205960 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.207746 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.208157 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.208160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.208160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.208249 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.208583 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.208584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.208585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.208824 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.209016 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.209082 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.209203 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260808 14:36:04.209434 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.202162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55252 (local address 127.20.81.62:41645)
0808 14:36:04.202231 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.202234 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.202398 (+ 164us) server_negotiation.cc:407] Connection header received
0808 14:36:04.202473 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.202474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.202486 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.202544 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.202959 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.203507 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.204511 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.204757 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.204839 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.206820 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.206821 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.206822 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.206829 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.208204 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.208595 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.208596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.208597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.208661 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.208857 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.208858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.208858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.209015 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.209091 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.209263 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.209343 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:36:04.209448 27981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.202102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55252)
0808 14:36:04.202298 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.202338 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.202417 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.202572 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.202575 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.202815 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.202874 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.202876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.203603 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.203604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.204421 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.204424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.204850 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.204851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.204924 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.205364 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.205377 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.206721 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.208292 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.208299 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.208301 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.208503 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.208724 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.208725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.208726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.208790 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.209084 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.209090 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.209140 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.209236 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.209343 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":96,"threads_started":1}
I20260808 14:36:04.210196 27977 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.61@KRBTEST.COM for oryx/127.20.81.61@KRBTEST.COM
I20260808 14:36:04.215680 27981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.210438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.0.0.1:54588)
0808 14:36:04.210525 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.210536 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.210579 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.210697 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.210697 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.210823 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.210861 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.210862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.211451 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.211452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.211911 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.211912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.212276 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.212277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.212338 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.212707 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.212711 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.213759 (+ 1048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.214949 (+ 1190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.214950 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.214950 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.215106 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.215264 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.215264 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.215264 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.215310 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.215469 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.215470 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.215505 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.215555 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.215625 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 14:36:04.215791 27980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.210495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54588 (local address 127.20.81.61:44229)
0808 14:36:04.210528 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.210530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.210565 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:36:04.210632 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.210633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.210641 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.210693 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.210939 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.211379 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.211993 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.212195 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.212276 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.213829 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.213830 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.213831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.213836 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.214882 (+ 1046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.215165 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.215166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.215166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.215210 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.215348 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.215348 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.215348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.215426 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.215467 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.215571 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.215666 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":15}
I20260808 14:36:04.217051 27977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: Bootstrap starting.
I20260808 14:36:04.217799 27977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:04.218083 27977 log.cc:824] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:04.218784 27977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: No bootstrap required, opened a new log
I20260808 14:36:04.220163 27977 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } }
I20260808 14:36:04.220286 27977 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:04.220341 27977 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfbba2f18a84213bb37107d003e71cb, State: Initialized, Role: FOLLOWER
I20260808 14:36:04.220479 27977 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } }
I20260808 14:36:04.220755 27983 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } } }
I20260808 14:36:04.220794 27977 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:04.220851 27983 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:36:04.222440 27996 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:36:04.222523 27996 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:36:04.224170 27907 master_runner.cc:428] Detected that this master ecfbba2f18a84213bb37107d003e71cb is joining an existing cluster
I20260808 14:36:04.224255 27907 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.81.61:44229
I20260808 14:36:04.231803 27980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.225525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54600 (local address 127.20.81.61:44229)
0808 14:36:04.225559 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.225561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.225654 (+ 93us) server_negotiation.cc:407] Connection header received
0808 14:36:04.225735 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.225736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.225743 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.225765 (+ 22us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.226119 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.226570 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.227613 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.227866 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.227928 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.228933 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.228934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.228934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.228940 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.230633 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.231020 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.231021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.231021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.231069 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.231284 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.231284 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.231285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.231400 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.231440 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.231621 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.231690 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:36:04.232112 28003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.225470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.0.0.1:54600)
0808 14:36:04.225602 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.225611 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.225673 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.225811 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.225811 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.225998 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.226045 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.226047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.226651 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.226652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.227534 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.227537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.227941 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.227942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.228007 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.228435 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.228440 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.228848 (+ 408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.230721 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.230722 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.230722 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.230923 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.231154 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.231154 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.231155 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.231214 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.231480 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.231481 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.231516 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.231917 (+ 401us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.232025 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
I20260808 14:36:04.233086 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.225332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55258 (local address 127.20.81.62:41645)
0808 14:36:04.225383 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.225385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.225510 (+ 125us) server_negotiation.cc:407] Connection header received
0808 14:36:04.225626 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.225627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.225638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.225693 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.226679 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.227425 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.228508 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.228836 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.228906 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.230082 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.230084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.230084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.230092 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.231805 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.232342 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.232343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.232344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.232414 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.232637 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.232639 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.232639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.232761 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.232817 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.232969 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.233026 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:36:04.233166 28002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.225244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55258)
0808 14:36:04.225432 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.225446 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.225543 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.225706 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.225707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.225934 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.226037 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.226039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.227509 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.227511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.228370 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.228373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.228930 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.228931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.229013 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.229577 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.229582 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.229983 (+ 401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.232027 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.232028 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.232028 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.232244 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.232491 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.232491 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.232491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.232582 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.232828 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.232829 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.232873 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.232951 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.233060 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.62@KRBTEST.COM for oryx/127.20.81.61@KRBTEST.COM
I20260808 14:36:04.242607 27980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.235497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54604 (local address 127.20.81.61:44229)
0808 14:36:04.235535 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.235537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.235693 (+ 156us) server_negotiation.cc:407] Connection header received
0808 14:36:04.235779 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.235780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.235788 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.235831 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.236294 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.236785 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.237855 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.238024 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.238072 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.240076 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.240077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.240078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.240085 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.241435 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.241832 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.241833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.241834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.241886 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.242085 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.242086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.242086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.242191 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.242256 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.242437 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.242519 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:36:04.242621 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.235450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.0.0.1:54604)
0808 14:36:04.235589 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.235631 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.235706 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.235837 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.235839 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.236167 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.236226 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.236228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.236855 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.236856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.237780 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.237782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.238090 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.238091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.238169 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.238553 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.238559 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.239990 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.241542 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.241549 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.241551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.241747 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.241955 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.241956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.241956 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.242024 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.242262 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.242270 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.242320 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.242411 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.242525 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":85,"threads_started":1}
I20260808 14:36:04.243112 27408 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.81.61:44229: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb"
member_type: NON_VOTER
last_known_addr {
host: "127.20.81.61"
port: 44229
}
attrs {
promote: true
}
}
dest_uuid: "6ad6bbdae9114e269066d0d8315fcb63"
cas_config_opid_index: -1
I20260808 14:36:04.243463 27408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } }
I20260808 14:36:04.243947 28005 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ecfbba2f18a84213bb37107d003e71cb (127.20.81.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } } }
I20260808 14:36:04.244269 27951 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:04.245098 28005 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.81.61:44229
I20260808 14:36:04.245239 27951 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Refusing update from remote peer 6ad6bbdae9114e269066d0d8315fcb63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 14:36:04.245370 27907 master.cc:537] Master@127.20.81.61:44229 shutting down...
I20260808 14:36:04.245360 28006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } } }
I20260808 14:36:04.245437 28006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:04.245539 28006 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:36:04.246389 27394 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 14:36:04.246953 27394 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 -> Peer ecfbba2f18a84213bb37107d003e71cb (127.20.81.61:44229): Couldn't send request to peer ecfbba2f18a84213bb37107d003e71cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:36:04.248063 27907 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:04.248154 27907 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:04.248205 27907 tablet_replica.cc:330] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: stopping tablet replica
I20260808 14:36:04.250849 27907 master.cc:552] Master@127.20.81.61:44229 shutdown complete.
I20260808 14:36:04.250916 27907 master_runner.cc:305] Clearing existing system tablet
I20260808 14:36:04.251056 27907 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:04.251103 27907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:04.251811 27907 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.000s
I20260808 14:36:04.252269 28010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.252419 27907 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.252480 27907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.252506 27907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal
uuid: "ecfbba2f18a84213bb37107d003e71cb"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "120a21f78ad8e5752216bf28f79f40af"
server_key_iv: "4778fdb42032a2b1beb57c6ab71b8680"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.253441 27907 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:04.254828 27907 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:36:04.254897 27907 log.cc:1196] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 14:36:04.255115 27907 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: Deleting consensus metadata
I20260808 14:36:04.255260 27907 master_runner.cc:315] Copying system tablet from 127.20.81.62:41645
I20260808 14:36:04.255839 27907 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: tablet copy: Beginning tablet copy session from remote peer at address 127.20.81.62:41645
I20260808 14:36:04.261976 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.256210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55270 (local address 127.20.81.62:41645)
0808 14:36:04.256255 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.256257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.256323 (+ 66us) server_negotiation.cc:407] Connection header received
0808 14:36:04.256390 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.256391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.256399 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.256445 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.256813 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.257286 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.258314 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.258495 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.258545 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.259512 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.259513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.259514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.259520 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.260962 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.261321 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.261322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.261323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.261370 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.261559 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.261560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.261560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.261653 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.261702 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.261860 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.261917 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:36:04.262053 28016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.256125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55270)
0808 14:36:04.256250 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.256261 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.256324 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.256450 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.256451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.256687 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.256746 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.256748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.257358 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.257359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.258236 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.258239 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.258562 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.258563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.258636 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.259046 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.259051 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.259423 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.261035 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.261036 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.261036 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.261251 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.261434 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.261435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.261435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.261500 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.261711 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.261712 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.261758 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.261826 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.261931 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":84,"threads_started":1}
I20260808 14:36:04.262380 27430 tablet_copy_service.cc:140] P 6ad6bbdae9114e269066d0d8315fcb63: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ecfbba2f18a84213bb37107d003e71cb ({username='oryx', principal='oryx/127.20.81.61@KRBTEST.COM'} at 127.0.0.1:55270)
I20260808 14:36:04.262524 27430 tablet_copy_service.cc:161] P 6ad6bbdae9114e269066d0d8315fcb63: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ecfbba2f18a84213bb37107d003e71cb at {username='oryx', principal='oryx/127.20.81.61@KRBTEST.COM'} at 127.0.0.1:55270: session id = ecfbba2f18a84213bb37107d003e71cb-00000000000000000000000000000000
I20260808 14:36:04.263450 27430 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:36:04.264042 27907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:36:04.265133 27907 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: tablet copy: Starting download of 0 data blocks...
I20260808 14:36:04.265291 27907 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: tablet copy: Starting download of 1 WAL segments...
I20260808 14:36:04.266234 27907 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:36:04.266990 27430 tablet_copy_service.cc:342] P 6ad6bbdae9114e269066d0d8315fcb63: Request end of tablet copy session ecfbba2f18a84213bb37107d003e71cb-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.81.61@KRBTEST.COM'} at 127.0.0.1:55270
I20260808 14:36:04.267050 27430 tablet_copy_service.cc:433] P 6ad6bbdae9114e269066d0d8315fcb63: ending tablet copy session ecfbba2f18a84213bb37107d003e71cb-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ecfbba2f18a84213bb37107d003e71cb
I20260808 14:36:04.269484 27907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:04.270555 28017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:04.270781 27907 server_base.cc:1034] running on GCE node
W20260808 14:36:04.270745 28020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.270617 28018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:04.271116 27907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:04.271274 27907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:04.272404 27907 hybrid_clock.cc:648] HybridClock initialized: now 1786199764272397 us; error 25 us; skew 500 ppm
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:04.273636 27907 init.cc:377] Logged in from keytab as oryx/127.20.81.61@KRBTEST.COM (short username oryx)
I20260808 14:36:04.273910 27907 webserver.cc:460] Webserver started at http://127.20.81.61:42863/ using document root <none> and password file <none>
I20260808 14:36:04.274050 27907 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:04.274086 27907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:04.274665 27907 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:04.275162 28028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.275276 27907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:04.275324 27907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal
uuid: "ecfbba2f18a84213bb37107d003e71cb"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "120a21f78ad8e5752216bf28f79f40af"
server_key_iv: "4778fdb42032a2b1beb57c6ab71b8680"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.275381 27907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.283358 27907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:04.285006 27907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:04.288111 27907 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.61:44229
I20260808 14:36:04.288280 28082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.61:44229 every 8 connection(s)
I20260808 14:36:04.288470 27907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
I20260808 14:36:04.289242 28083 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:36:04.289644 28083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: Bootstrap starting.
I20260808 14:36:04.291926 28083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:36:04.292155 28083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: Bootstrap complete.
I20260808 14:36:04.292348 28083 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } }
I20260808 14:36:04.292428 28083 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ecfbba2f18a84213bb37107d003e71cb, State: Initialized, Role: LEARNER
I20260808 14:36:04.292472 28083 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } }
I20260808 14:36:04.292666 28083 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:04.292711 28086 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } } }
I20260808 14:36:04.292804 28086 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: This master's current role is: LEARNER
I20260808 14:36:04.294063 28097 catalog_manager.cc:1259] Loaded cluster ID: 10bad0bf1b2043fb95d063a3b70eb8e2
I20260808 14:36:04.294108 28097 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: loading cluster ID for follower catalog manager: success
I20260808 14:36:04.295063 28097 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: acquiring CA information for follower catalog manager: success
I20260808 14:36:04.295331 28097 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:36:04.317803 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.311091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54624 (local address 127.20.81.61:44229)
0808 14:36:04.311230 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.311232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.311239 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:04.311268 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.311269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.311281 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.311357 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.311940 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.312678 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.313407 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.313626 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.313699 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.315030 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.315032 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.315032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.315040 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.316531 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.316987 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.316988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.316989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.317046 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.317253 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.317254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.317254 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.317357 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.317433 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.317621 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.317690 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
WARNING: no policy specified for oryx/127.20.81.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.60.keytab.
Entry for principal oryx/127.20.81.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.60.keytab.
I20260808 14:36:04.345686 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.60:46303
--webserver_interface=127.20.81.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.60.keytab
--principal=oryx/127.20.81.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:41645,127.20.81.61:44229,127.20.81.60:46303
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:04.428694 28101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:04.428900 28101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:04.428936 28101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:04.430054 28101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:04.430115 28101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:04.430141 28101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:04.430179 28101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:04.430205 28101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:04.431684 28101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:41645,127.20.81.61:44229,127.20.81.60:46303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.60.keytab
--principal=oryx/127.20.81.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.60:46303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.81.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:04.431947 28101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:04.432166 28101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:04.436983 28107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.436976 28109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.436980 28106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:04.437080 28101 server_base.cc:1034] running on GCE node
I20260808 14:36:04.437424 28101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:04.437661 28101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:04.438815 28101 hybrid_clock.cc:648] HybridClock initialized: now 1786199764438801 us; error 27 us; skew 500 ppm
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:04.441474 28101 init.cc:377] Logged in from keytab as oryx/127.20.81.60@KRBTEST.COM (short username oryx)
I20260808 14:36:04.441936 28101 webserver.cc:460] Webserver started at http://127.20.81.60:33931/ using document root <none> and password file <none>
I20260808 14:36:04.442183 28101 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:04.442229 28101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:04.442384 28101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:04.443459 28101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data/instance:
uuid: "0c13e564f70e493db9921d85660ad308"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "fac674406ca65da1b13b48a5454e0a45"
server_key_iv: "67293930281654aac808ac542af98deb"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.443836 28101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal/instance:
uuid: "0c13e564f70e493db9921d85660ad308"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "fac674406ca65da1b13b48a5454e0a45"
server_key_iv: "67293930281654aac808ac542af98deb"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.445263 28101 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:36:04.446290 28116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.446484 28101 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:04.446587 28101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal
uuid: "0c13e564f70e493db9921d85660ad308"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "fac674406ca65da1b13b48a5454e0a45"
server_key_iv: "67293930281654aac808ac542af98deb"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.446662 28101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.476765 28101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:04.478787 28101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:04.478946 28101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:04.483197 28101 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.60:46303
I20260808 14:36:04.483331 28173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.60:46303 every 8 connection(s)
I20260808 14:36:04.483599 28101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
I20260808 14:36:04.484613 28174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:04.486158 28174 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:36:04.491465 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 28101
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.60@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:04.495355 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.486910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55284 (local address 127.20.81.62:41645)
0808 14:36:04.486995 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.486998 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.487099 (+ 101us) server_negotiation.cc:407] Connection header received
0808 14:36:04.487578 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.487579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.487590 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.487633 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.488217 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.488793 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.489724 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.489902 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.489953 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.492126 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.492127 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.492127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.492135 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.493966 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.494385 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.494386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.494387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.494455 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.494710 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.494711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.494711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.494829 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.494904 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.495182 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.495265 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:36:04.495550 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.486814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55284)
0808 14:36:04.486985 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.487024 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.487470 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.487711 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.487715 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.487957 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.488147 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.488151 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.488869 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.488870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.489654 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.489656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.489979 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.489980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.490092 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.490529 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.490537 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.492030 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.494046 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.494052 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.494054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.494310 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.494513 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.494514 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.494514 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.494633 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.494896 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.494902 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.495039 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.495139 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.495296 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
I20260808 14:36:04.496328 28174 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.81.60@KRBTEST.COM
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.60@KRBTEST.COM for oryx/127.20.81.61@KRBTEST.COM
I20260808 14:36:04.501144 28177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.492048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51070 (local address 127.20.81.60:46303)
0808 14:36:04.492192 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.492197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.492217 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:36:04.492238 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.492241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.492255 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.492332 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.493178 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.494341 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.495062 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.495376 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.495510 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.498190 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.498198 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.498198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.498205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.499890 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.500292 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.500295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.500295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.500353 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.500574 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.500575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.500576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.500713 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.500859 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.500947 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.501024 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
I20260808 14:36:04.503293 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.496629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.0.0.1:54638)
0808 14:36:04.496667 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.496680 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.496725 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.497363 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.497365 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.497516 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.497573 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.497575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.498269 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.498270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.498759 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.498760 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.499146 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.499147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.499216 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.499569 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.499573 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.500739 (+ 1166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.502358 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.502359 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.502359 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.502513 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.502793 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.502799 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.502799 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.502852 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.503079 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.503079 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.503114 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.503164 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.503235 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:36:04.503306 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.497170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54638 (local address 127.20.81.61:44229)
0808 14:36:04.497239 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.497241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.497249 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:36:04.497274 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.497275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.497293 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.497340 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.497648 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.498170 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.498844 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.499063 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.499145 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.500828 (+ 1683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.500829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.500830 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.500842 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.502287 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.502615 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.502616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.502617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.502688 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.502901 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.502902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.502902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.503021 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.503077 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.503182 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.503247 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:36:04.503669 28174 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.60@KRBTEST.COM for oryx/127.20.81.60@KRBTEST.COM
I20260808 14:36:04.509501 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.503887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.0.0.1:51082)
0808 14:36:04.503929 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.503940 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.503979 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.504082 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.504082 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.504183 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.504208 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.504209 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.504824 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.504825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.505272 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.505273 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.505568 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.505569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.505603 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.505912 (+ 309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.505916 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.507019 (+ 1103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.508489 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.508490 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.508491 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.508715 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.508910 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.508910 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.508911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.508963 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.509191 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.509192 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.509227 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.509291 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.509381 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 14:36:04.509508 28177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.503926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51082 (local address 127.20.81.60:46303)
0808 14:36:04.503965 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.503967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.503978 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:36:04.504032 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.504033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.504040 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.504079 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.504261 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.504754 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.505329 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.505512 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.505559 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.507096 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.507097 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.507097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.507104 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.508406 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.508794 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.508795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.508796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.508848 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.509028 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.509030 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.509030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.509130 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.509200 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.509315 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.509429 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":17}
I20260808 14:36:04.510852 28174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Bootstrap starting.
I20260808 14:36:04.511708 28174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:04.511993 28174 log.cc:824] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:04.512780 28174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: No bootstrap required, opened a new log
I20260808 14:36:04.514201 28174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } }
I20260808 14:36:04.514329 28174 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:04.514372 28174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c13e564f70e493db9921d85660ad308, State: Initialized, Role: FOLLOWER
I20260808 14:36:04.514498 28174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } }
I20260808 14:36:04.514796 28174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:04.514763 28179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } } }
I20260808 14:36:04.514861 28179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:36:04.516321 28190 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:36:04.516381 28190 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:36:04.518603 28101 master_runner.cc:428] Detected that this master 0c13e564f70e493db9921d85660ad308 is joining an existing cluster
I20260808 14:36:04.518666 28101 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.81.60:46303
I20260808 14:36:04.526458 28177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.519993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51090 (local address 127.20.81.60:46303)
0808 14:36:04.520048 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.520050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.520057 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:04.520076 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.520077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.520086 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.520144 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.520616 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.521351 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.522441 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.522727 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.522768 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.523828 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.523829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.523829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.523835 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.525391 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.525711 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.525712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.525712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.525771 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.525947 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.525948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.525949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.526080 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.526152 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.526257 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.526373 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":37}
I20260808 14:36:04.526556 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.519685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.0.0.1:51090)
0808 14:36:04.519807 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.519816 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.519873 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.520159 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.520160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.520421 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.520504 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.520506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.521434 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.521434 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.522351 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.522353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.522854 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.522855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.522938 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.523395 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.523399 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.523749 (+ 350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.525467 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.525468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.525468 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.525641 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.525843 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.525844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.525844 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.525894 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.526141 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.526142 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.526185 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.526235 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.526310 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":62,"thread_start_us":64,"threads_started":1}
I20260808 14:36:04.544476 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.519656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55288 (local address 127.20.81.62:41645)
0808 14:36:04.520049 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.520052 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.520060 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:36:04.520083 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.520084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.520094 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.520161 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.520686 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.521418 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.522445 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.522735 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.522771 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.541617 (+ 18846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.541619 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.541619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.541629 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.543229 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.543585 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.543587 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.543587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.543648 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.543856 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.543858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.543858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.544026 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.544101 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.544270 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.544378 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366}
I20260808 14:36:04.544466 28196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.519608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55288)
0808 14:36:04.519773 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.519783 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.519831 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.520256 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.520257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.520497 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.520601 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.520603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.521507 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.521507 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.522353 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.522354 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.522855 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.522856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.522938 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.541166 (+ 18228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.541171 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.541499 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.543338 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.543339 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.543340 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.543510 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.543713 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.543713 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.543714 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.543780 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.544100 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.544101 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.544156 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.544231 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.544348 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":5,"thread_start_us":107,"threads_started":1}
I20260808 14:36:04.545290 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.519859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.0.0.1:54646)
0808 14:36:04.519958 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.519967 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.520009 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.520440 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.520441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.520706 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.520782 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.520784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.521744 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.521745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.522644 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.522647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.523513 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.523514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.523581 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.541537 (+ 17956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.541543 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.541934 (+ 391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.543749 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.543750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.543750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.543933 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.544160 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.544160 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.544161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.544223 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.544960 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.544961 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.545015 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.545096 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.545195 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"mutex_wait_us":1,"thread_start_us":64,"threads_started":1}
I20260808 14:36:04.545312 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.520256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54646 (local address 127.20.81.61:44229)
0808 14:36:04.520304 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.520306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.520313 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:04.520333 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.520334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.520343 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.520393 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.520882 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.521636 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.522746 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.523055 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.523417 (+ 362us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.542067 (+ 18650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.542069 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.542069 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.542077 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.543658 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.544007 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.544009 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.544009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.544084 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.544296 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.544297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.544298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.544430 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.544476 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.545126 (+ 650us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.545220 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199763, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.62@KRBTEST.COM for oryx/127.20.81.60@KRBTEST.COM
I20260808 14:36:04.552531 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 27474
I20260808 14:36:04.554087 28177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.547329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51098 (local address 127.20.81.60:46303)
0808 14:36:04.547370 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.547372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.547380 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:36:04.547415 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.547416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.547426 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.547505 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.547740 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.548466 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.549177 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.549400 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.549506 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.551418 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.551419 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.551420 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.551427 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.553041 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.553379 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.553379 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.553380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.553422 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.553578 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.553579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.553579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.553686 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.553757 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.553926 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.553999 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:36:04.554093 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.547146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.0.0.1:51098)
0808 14:36:04.547201 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.547212 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.547255 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.547509 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.547509 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.547633 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.547675 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.547676 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.548539 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.548540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.549079 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.549080 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.549490 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.549491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.549609 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.549936 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.549941 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.551336 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.553125 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.553126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.553126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.553317 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.553476 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.553476 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.553477 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.553526 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.553764 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.553765 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.553809 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.553886 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.553996 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 14:36:04.561137 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:44465
--local_ip_for_outbound_sockets=127.20.81.1
--tserver_master_addrs=127.20.81.62:41645
--webserver_port=33161
--webserver_interface=127.20.81.1
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab
--principal=oryx/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.81.62:41645,127.20.81.61:44229
--tserver_master_addrs=127.20.81.62:41645,127.20.81.61:44229,127.20.81.60:46303 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:04.561278 27408 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.81.60:46303: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "0c13e564f70e493db9921d85660ad308"
member_type: NON_VOTER
last_known_addr {
host: "127.20.81.60"
port: 46303
}
attrs {
promote: true
}
}
dest_uuid: "6ad6bbdae9114e269066d0d8315fcb63"
cas_config_opid_index: 5
I20260808 14:36:04.561550 27408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } }
I20260808 14:36:04.561954 28006 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0c13e564f70e493db9921d85660ad308 (127.20.81.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.563004 28006 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.81.60:46303
I20260808 14:36:04.563082 28006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.563150 28006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:04.563243 28145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:04.563426 28101 master.cc:537] Master@127.20.81.60:46303 shutting down...
I20260808 14:36:04.564392 28145 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 FOLLOWER]: Refusing update from remote peer 6ad6bbdae9114e269066d0d8315fcb63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:36:04.564695 28005 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:36:04.565497 27395 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 -> Peer 0c13e564f70e493db9921d85660ad308 (127.20.81.60:46303): Couldn't send request to peer 0c13e564f70e493db9921d85660ad308. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:36:04.567744 28101 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:04.567839 28101 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:04.567891 28101 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: stopping tablet replica
I20260808 14:36:04.569689 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.562039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.0.0.1:54654)
0808 14:36:04.562144 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.562155 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.562194 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.566065 (+ 3871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.566066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.566069 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:04.566120 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.566122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.567193 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.567195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.568449 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.568452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.569414 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.569416 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.569485 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.569516 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.569570 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.569616 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 14:36:04.569895 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.562789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54654 (local address 127.20.81.61:44229)
0808 14:36:04.565767 (+ 2978us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.565770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.565780 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:04.565810 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.565811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.565841 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.565916 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:04.566256 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.567093 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.568595 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.569230 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.569304 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.569378 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.569790 (+ 412us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.569832 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2944}
I20260808 14:36:04.570176 28057 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 LEARNER]: Refusing update from remote peer 6ad6bbdae9114e269066d0d8315fcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:36:04.570614 28005 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 14:36:04.571223 28057 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0c13e564f70e493db9921d85660ad308 (127.20.81.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.572664 28086 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ad6bbdae9114e269066d0d8315fcb63. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.572755 28086 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: This master's current role is: LEARNER
I20260808 14:36:04.572793 28086 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: NON_VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: true } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.572832 28086 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: This master's current role is: LEARNER
I20260808 14:36:04.572829 28101 master.cc:552] Master@127.20.81.60:46303 shutdown complete.
I20260808 14:36:04.572870 28101 master_runner.cc:305] Clearing existing system tablet
I20260808 14:36:04.573009 28101 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:04.573057 28101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:04.573065 28005 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: attempting to promote NON_VOTER ecfbba2f18a84213bb37107d003e71cb to VOTER
I20260808 14:36:04.573247 28005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } }
I20260808 14:36:04.573901 28057 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 LEARNER]: Refusing update from remote peer 6ad6bbdae9114e269066d0d8315fcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 14:36:04.574045 28101 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:04.574084 28006 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 14:36:04.574481 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.573626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.0.0.1:51102)
0808 14:36:04.574405 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.574452 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":762}
I20260808 14:36:04.574827 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.574745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.0.0.1:51118)
0808 14:36:04.574780 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.574801 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 14:36:04.574854 28006 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ecfbba2f18a84213bb37107d003e71cb (127.20.81.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
W20260808 14:36:04.574952 27395 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 -> Peer 0c13e564f70e493db9921d85660ad308 (127.20.81.60:46303): Couldn't send request to peer 0c13e564f70e493db9921d85660ad308. Status: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:36:04.575095 28207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.575218 28101 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.575260 28101 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:36:04.575281 28101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal
uuid: "0c13e564f70e493db9921d85660ad308"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "fac674406ca65da1b13b48a5454e0a45"
server_key_iv: "67293930281654aac808ac542af98deb"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.575716 28006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.575786 28006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:04.575847 28006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.575887 28006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:04.576051 28101 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:04.576165 28057 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ecfbba2f18a84213bb37107d003e71cb (127.20.81.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.577019 28086 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.577087 28086 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:04.577431 28101 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:36:04.577498 28101 log.cc:1196] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 14:36:04.577690 28101 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Deleting consensus metadata
I20260808 14:36:04.577951 28101 master_runner.cc:315] Copying system tablet from 127.20.81.62:41645
I20260808 14:36:04.578579 28101 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: tablet copy: Beginning tablet copy session from remote peer at address 127.20.81.62:41645
I20260808 14:36:04.586004 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.578969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55292 (local address 127.20.81.62:41645)
0808 14:36:04.579010 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.579012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.579021 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:04.579072 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.579073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.579082 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.579138 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.579463 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.580221 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.581552 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.581911 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.581981 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.583112 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.583113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.583114 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.583121 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.584799 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.585199 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.585200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.585200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.585260 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.585460 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.585460 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.585461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.585607 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.585672 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.585835 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.585911 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:36:04.586019 28213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.578822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55292)
0808 14:36:04.578946 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.578957 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.579019 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.579141 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.579142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.579340 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.579391 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.579393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.580302 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.580303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.581423 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.581426 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.581996 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.581997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.582059 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.582605 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.582611 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.583025 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.584892 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.584894 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.584895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.585125 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.585327 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.585328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.585328 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.585394 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.585675 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.585676 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.585722 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.585797 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.585901 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
I20260808 14:36:04.586614 27430 tablet_copy_service.cc:140] P 6ad6bbdae9114e269066d0d8315fcb63: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 0c13e564f70e493db9921d85660ad308 ({username='oryx', principal='oryx/127.20.81.60@KRBTEST.COM'} at 127.0.0.1:55292)
I20260808 14:36:04.586668 27430 tablet_copy_service.cc:161] P 6ad6bbdae9114e269066d0d8315fcb63: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 0c13e564f70e493db9921d85660ad308 at {username='oryx', principal='oryx/127.20.81.60@KRBTEST.COM'} at 127.0.0.1:55292: session id = 0c13e564f70e493db9921d85660ad308-00000000000000000000000000000000
I20260808 14:36:04.587248 27430 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:36:04.587860 28101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:36:04.589195 28101 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: tablet copy: Starting download of 0 data blocks...
I20260808 14:36:04.589344 28101 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: tablet copy: Starting download of 1 WAL segments...
I20260808 14:36:04.590051 28101 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:36:04.590921 27430 tablet_copy_service.cc:342] P 6ad6bbdae9114e269066d0d8315fcb63: Request end of tablet copy session 0c13e564f70e493db9921d85660ad308-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.81.60@KRBTEST.COM'} at 127.0.0.1:55292
I20260808 14:36:04.590971 27430 tablet_copy_service.cc:433] P 6ad6bbdae9114e269066d0d8315fcb63: ending tablet copy session 0c13e564f70e493db9921d85660ad308-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 0c13e564f70e493db9921d85660ad308
I20260808 14:36:04.594357 28101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:04.595501 28214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.597605 28217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:04.597644 28101 server_base.cc:1034] running on GCE node
W20260808 14:36:04.603282 28215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:04.603507 28101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:04.603683 28101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:04.604820 28101 hybrid_clock.cc:648] HybridClock initialized: now 1786199764604813 us; error 25 us; skew 500 ppm
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:04.606374 28101 init.cc:377] Logged in from keytab as oryx/127.20.81.60@KRBTEST.COM (short username oryx)
I20260808 14:36:04.606667 28101 webserver.cc:460] Webserver started at http://127.20.81.60:38511/ using document root <none> and password file <none>
I20260808 14:36:04.606796 28101 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:04.606837 28101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:04.607650 28101 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:36:04.608637 28225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.608815 28101 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:04.608875 28101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal
uuid: "0c13e564f70e493db9921d85660ad308"
format_stamp: "Formatted at 2026-08-08 14:36:04 on dist-test-slave-8n49"
server_key: "fac674406ca65da1b13b48a5454e0a45"
server_key_iv: "67293930281654aac808ac542af98deb"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.608943 28101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.615514 28101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:04.617363 28101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:04.620667 28101 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.60:46303
I20260808 14:36:04.621058 28101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
I20260808 14:36:04.622040 28280 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:36:04.622613 28280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Bootstrap starting.
I20260808 14:36:04.623961 28279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.60:46303 every 8 connection(s)
I20260808 14:36:04.625802 28280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:36:04.626070 28280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Bootstrap complete.
I20260808 14:36:04.626283 28280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } }
I20260808 14:36:04.626387 28280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0c13e564f70e493db9921d85660ad308, State: Initialized, Role: LEARNER
I20260808 14:36:04.626428 28280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } }
I20260808 14:36:04.626608 28280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:04.626612 28283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.626827 28283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:36:04.628122 28294 catalog_manager.cc:1259] Loaded cluster ID: 10bad0bf1b2043fb95d063a3b70eb8e2
I20260808 14:36:04.628345 28294 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: loading cluster ID for follower catalog manager: success
I20260808 14:36:04.629535 28294 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: acquiring CA information for follower catalog manager: success
I20260808 14:36:04.629890 28294 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 14:36:04.660401 28200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:04.660673 28200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:04.660715 28200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:04.661835 28200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:04.661897 28200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:04.661942 28200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:36:04.663398 28200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab
--principal=oryx/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:44465
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=33161
--tserver_master_addrs=127.20.81.62:41645,127.20.81.61:44229,127.20.81.60:46303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:04.663657 28200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:04.663883 28200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:04.669591 28300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.669597 28299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.669629 28302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:04.670117 28200 server_base.cc:1034] running on GCE node
I20260808 14:36:04.670305 28200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:04.670544 28200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:04.671694 28200 hybrid_clock.cc:648] HybridClock initialized: now 1786199764671680 us; error 31 us; skew 500 ppm
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:04.674769 28200 init.cc:377] Logged in from keytab as oryx/127.20.81.1@KRBTEST.COM (short username oryx)
I20260808 14:36:04.675253 28200 webserver.cc:460] Webserver started at http://127.20.81.1:33161/ using document root <none> and password file <none>
I20260808 14:36:04.675484 28200 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:04.675562 28200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:04.677089 28200 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:36:04.677817 28311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.677996 28200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:04.678090 28200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "395a5392b7394c729a8614b18e333444"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "7d398c4e10425f71c9cd4ec1a3b9f768"
server_key_iv: "73dc66d0c82fb3a0167d7490df6f3e2f"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.678432 28200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.688094 28200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:04.689958 28200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:04.690151 28200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:04.690385 28200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:04.690706 28200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:04.690739 28200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.690779 28200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:04.690805 28200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.696789 28200 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:44465
I20260808 14:36:04.696869 28432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:44465 every 8 connection(s)
I20260808 14:36:04.697216 28200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.61@KRBTEST.COM
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.60@KRBTEST.COM
I20260808 14:36:04.707401 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 28200
I20260808 14:36:04.707577 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 27620
I20260808 14:36:04.708904 28438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.698255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.20.81.1:53275)
0808 14:36:04.699448 (+ 1193us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.699457 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.699527 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.699661 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.699662 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.699939 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.700150 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.700154 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.700913 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.700914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.701708 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.701710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.702098 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.702099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.702223 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.702718 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.702727 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.704455 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.706326 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.706333 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.706335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.706557 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.706787 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.706788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.706789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.706933 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.707303 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.707310 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.707430 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.707584 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.708637 (+ 1053us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1175,"thread_start_us":65,"threads_started":1}
I20260808 14:36:04.709674 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.698353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:53275 (local address 127.20.81.61:44229)
0808 14:36:04.698404 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.698406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.699502 (+ 1096us) server_negotiation.cc:407] Connection header received
0808 14:36:04.699597 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.699598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.699610 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.699657 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.700244 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.700806 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.701798 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.701996 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.702081 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.704571 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.704573 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.704573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.704581 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.706236 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.706643 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.706645 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.706645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.706707 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.707019 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.707022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.707022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.707200 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.707266 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.707624 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.709613 (+ 1989us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:36:04.710026 28435 heartbeater.cc:347] Connected to a master server at 127.20.81.61:44229
I20260808 14:36:04.710124 28435 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:04.710311 28435 heartbeater.cc:511] Master 127.20.81.61:44229 requested a full tablet report, sending...
I20260808 14:36:04.710850 28045 ts_manager.cc:194] Registered new tserver with Master: 395a5392b7394c729a8614b18e333444 (127.20.81.1:44465)
I20260808 14:36:04.714592 28440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.697962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.20.81.1:38205)
0808 14:36:04.698455 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.698489 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.699275 (+ 786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.699751 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.699752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.699993 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.700151 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.700157 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.701378 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.701378 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.702150 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.702152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.702653 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.702654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.702728 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.703200 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.703204 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.705282 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.713398 (+ 8116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.713399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.713399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.713608 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.713836 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.713836 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.713837 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.713897 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.714220 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.714221 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.714267 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.714333 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.714435 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"mutex_wait_us":7,"thread_start_us":95,"threads_started":1}
I20260808 14:36:04.714762 28439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.698233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:38205 (local address 127.20.81.60:46303)
0808 14:36:04.698345 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.698347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.698555 (+ 208us) server_negotiation.cc:407] Connection header received
0808 14:36:04.699361 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.699362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.699377 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.699458 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.700258 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.701295 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.702227 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.702529 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.702586 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.705813 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.705814 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.705814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.705823 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.713290 (+ 7467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.713683 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.713684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.713685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.713759 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.713969 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.713970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.713971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.714149 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.714233 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.714381 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.714497 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":61,"threads_started":1}
I20260808 14:36:04.715165 28433 heartbeater.cc:347] Connected to a master server at 127.20.81.60:46303
I20260808 14:36:04.715209 28433 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:04.715281 28433 heartbeater.cc:511] Master 127.20.81.60:46303 requested a full tablet report, sending...
I20260808 14:36:04.715718 28243 ts_manager.cc:194] Registered new tserver with Master: 395a5392b7394c729a8614b18e333444 (127.20.81.1:44465)
I20260808 14:36:04.717027 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.697952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:58909 (local address 127.20.81.62:41645)
0808 14:36:04.697999 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.698002 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.698290 (+ 288us) server_negotiation.cc:407] Connection header received
0808 14:36:04.699385 (+ 1095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.699387 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.699401 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.699463 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.700262 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.701049 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.702126 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.702411 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.702450 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.705292 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.705294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.705294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.705301 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.706809 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.707214 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.707216 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.707216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.707306 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.716317 (+ 9011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.716319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.716320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.716489 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.716604 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.716785 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.716881 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:36:04.717350 28437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.697954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.1:58909)
0808 14:36:04.698146 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.698183 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.699258 (+ 1075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.699550 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.699554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.699993 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.700151 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.700157 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.701144 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.701145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.702028 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.702030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.702543 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.702544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.702625 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.703044 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.703049 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.705199 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.706900 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.706901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.706902 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.707106 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.716207 (+ 9101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.716207 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.716208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.716262 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.716620 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.716621 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.716668 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.716741 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.716850 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":3,"thread_start_us":100,"threads_started":1}
I20260808 14:36:04.717717 28434 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41645
I20260808 14:36:04.717772 28434 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:04.717842 28434 heartbeater.cc:511] Master 127.20.81.62:41645 requested a full tablet report, sending...
I20260808 14:36:04.718104 27408 ts_manager.cc:194] Re-registered known tserver with Master: 395a5392b7394c729a8614b18e333444 (127.20.81.1:44465)
I20260808 14:36:04.718509 27408 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:58909
I20260808 14:36:04.720925 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:46085
--local_ip_for_outbound_sockets=127.20.81.2
--tserver_master_addrs=127.20.81.62:41645
--webserver_port=34297
--webserver_interface=127.20.81.2
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab
--principal=oryx/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.81.62:41645,127.20.81.61:44229
--tserver_master_addrs=127.20.81.62:41645,127.20.81.61:44229,127.20.81.60:46303 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:04.804543 28441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:04.804800 28441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:04.804824 28441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:04.805984 28441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:04.806028 28441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:04.806054 28441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:36:04.807508 28441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab
--principal=oryx/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:46085
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=34297
--tserver_master_addrs=127.20.81.62:41645,127.20.81.61:44229,127.20.81.60:46303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:04.807737 28441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:04.807955 28441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:04.813261 28447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.813269 28449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.813270 28446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:04.813498 28441 server_base.cc:1034] running on GCE node
I20260808 14:36:04.813709 28441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:04.813963 28441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:04.815115 28441 hybrid_clock.cc:648] HybridClock initialized: now 1786199764815111 us; error 41 us; skew 500 ppm
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:04.817639 28441 init.cc:377] Logged in from keytab as oryx/127.20.81.2@KRBTEST.COM (short username oryx)
I20260808 14:36:04.818133 28441 webserver.cc:460] Webserver started at http://127.20.81.2:34297/ using document root <none> and password file <none>
I20260808 14:36:04.818356 28441 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:04.818432 28441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:04.819751 28441 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:04.820310 28458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.820474 28441 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:04.820613 28441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "3d96d6691b0e48d6b151abc4b0a4377b"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "0bc17a5dcbdfeaf0d811f99f00cd513a"
server_key_iv: "d8c3dc482fb3302426ba9ea8fffe8bb5"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.820963 28441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.838454 28441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:04.840355 28441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:04.840528 28441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:04.840816 28441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:04.841130 28441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:04.841180 28441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.841224 28441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:04.841249 28441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.847232 28441 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:46085
I20260808 14:36:04.847285 28576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:46085 every 8 connection(s)
I20260808 14:36:04.847632 28441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.60@KRBTEST.COM
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.61@KRBTEST.COM
I20260808 14:36:04.855968 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 28441
I20260808 14:36:04.856163 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 27764
I20260808 14:36:04.859427 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.848750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:49543 (local address 127.20.81.62:41645)
0808 14:36:04.848804 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.848807 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.848868 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:36:04.849794 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.849795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.849808 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.849859 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.850573 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.851085 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.852089 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.852294 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.852364 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.854832 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.854834 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.854835 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.854842 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.857149 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.857910 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.857911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.857912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.857977 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.858579 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.858580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.858580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.858737 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.858786 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.859212 (+ 426us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.859298 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:36:04.859978 28583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.848685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.2:49543)
0808 14:36:04.848817 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.848826 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.849698 (+ 872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.849948 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.849951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.850274 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.850473 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.850478 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.851189 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.851190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.851979 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.851981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.852384 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.852385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.852552 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.853153 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.853162 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.854738 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.857252 (+ 2514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.857260 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.857262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.857807 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.858074 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.858074 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.858075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.858214 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.858839 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.858846 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.859039 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.859531 (+ 492us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.859741 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":60,"threads_started":1}
I20260808 14:36:04.860448 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.848367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:34119 (local address 127.20.81.61:44229)
0808 14:36:04.848421 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.848423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.848726 (+ 303us) server_negotiation.cc:407] Connection header received
0808 14:36:04.849818 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.849820 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.849834 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.849868 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.850588 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.851353 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.852476 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.852812 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.852901 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.855768 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.855769 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.855770 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.855777 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.858925 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.859421 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.859422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.859423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.859480 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.859756 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.859757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.859757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.859885 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.859928 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.860259 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.860339 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:36:04.860813 28582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.848369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.20.81.2:34119)
0808 14:36:04.848568 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.848629 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.849683 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.849946 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.849951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.850351 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.850474 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.850481 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.851456 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.851457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.852387 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.852389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.852903 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.852904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.852973 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.853412 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.853417 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.855692 (+ 2275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.859146 (+ 3454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.859147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.859148 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.859336 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.859572 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.859573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.859574 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.859630 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.859977 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.859978 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.860021 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.860598 (+ 577us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.860705 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":43,"spinlock_wait_cycles":7936,"thread_start_us":97,"threads_started":1}
I20260808 14:36:04.860816 28439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.848436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:49713 (local address 127.20.81.60:46303)
0808 14:36:04.848477 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.848480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.848725 (+ 245us) server_negotiation.cc:407] Connection header received
0808 14:36:04.849819 (+ 1094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.849820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.849837 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.849868 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:04.850593 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.851353 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.852510 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.852801 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.852866 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.855298 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:04.855299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:04.855300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:04.855307 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:04.858111 (+ 2804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.859009 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.859010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.859010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.859070 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:04.860200 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:04.860201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:04.860201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:04.860344 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:04.860407 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.860644 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.860726 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:36:04.861078 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.848369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.20.81.2:49713)
0808 14:36:04.848630 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.848639 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.849683 (+ 1044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.849946 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.849951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.850350 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:04.850474 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.850481 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.851456 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.851457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.852387 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.852389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.852922 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.852923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.852995 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.853473 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:04.853478 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:04.855208 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:04.858279 (+ 3071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.858280 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.858280 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.858483 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.859685 (+ 1202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:04.859686 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:04.859686 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:04.860126 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:04.860434 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:04.860435 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:04.860490 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.860918 (+ 428us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.860999 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":37,"thread_start_us":99,"threads_started":1}
I20260808 14:36:04.866516 28579 heartbeater.cc:347] Connected to a master server at 127.20.81.61:44229
I20260808 14:36:04.866644 28579 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:04.866845 28579 heartbeater.cc:511] Master 127.20.81.61:44229 requested a full tablet report, sending...
I20260808 14:36:04.867322 28045 ts_manager.cc:194] Registered new tserver with Master: 3d96d6691b0e48d6b151abc4b0a4377b (127.20.81.2:46085)
I20260808 14:36:04.867772 28578 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41645
I20260808 14:36:04.867841 28578 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:04.867925 28578 heartbeater.cc:511] Master 127.20.81.62:41645 requested a full tablet report, sending...
I20260808 14:36:04.868171 28577 heartbeater.cc:347] Connected to a master server at 127.20.81.60:46303
I20260808 14:36:04.868191 27408 ts_manager.cc:194] Re-registered known tserver with Master: 3d96d6691b0e48d6b151abc4b0a4377b (127.20.81.2:46085)
I20260808 14:36:04.868220 28577 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:04.868287 28577 heartbeater.cc:511] Master 127.20.81.60:46303 requested a full tablet report, sending...
I20260808 14:36:04.868602 28243 ts_manager.cc:194] Registered new tserver with Master: 3d96d6691b0e48d6b151abc4b0a4377b (127.20.81.2:46085)
I20260808 14:36:04.868737 27408 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:49543
I20260808 14:36:04.871655 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:44117
--local_ip_for_outbound_sockets=127.20.81.3
--tserver_master_addrs=127.20.81.62:41645
--webserver_port=35589
--webserver_interface=127.20.81.3
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab
--principal=oryx/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.81.62:41645,127.20.81.61:44229
--tserver_master_addrs=127.20.81.62:41645,127.20.81.61:44229,127.20.81.60:46303 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:04.956871 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.953466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.0.0.1:51134)
0808 14:36:04.953565 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:04.953579 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:04.953656 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:04.953863 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:04.953864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:04.953865 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:04.953914 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.953916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.954917 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.954917 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.955644 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:04.955646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.956650 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.956652 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:04.956710 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.956715 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:36:04.956763 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 14:36:04.956804 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 14:36:04.956916 28439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:04.953596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51134 (local address 127.20.81.60:46303)
0808 14:36:04.953681 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:04.953684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:04.953698 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:36:04.953735 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:04.953736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:04.953763 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:04.953853 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:04.953988 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.954820 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.955735 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:04.956499 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:04.956637 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:04.956725 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:04.956790 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:36:04.956835 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:36:04.957273 28253 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 14:36:04.957469 28283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ad6bbdae9114e269066d0d8315fcb63. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:04.957607 28283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: This master's current role is: LEARNER
W20260808 14:36:04.965852 28584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:04.966090 28584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:04.966117 28584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:04.967411 28584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:04.967458 28584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:04.967487 28584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:36:04.969329 28584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab
--principal=oryx/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:44117
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=35589
--tserver_master_addrs=127.20.81.62:41645,127.20.81.61:44229,127.20.81.60:46303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:04.969609 28584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:04.969864 28584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:04.975270 28590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.975371 28593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:04.975270 28589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:04.975692 28584 server_base.cc:1034] running on GCE node
I20260808 14:36:04.975914 28584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:04.976202 28584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:04.977367 28584 hybrid_clock.cc:648] HybridClock initialized: now 1786199764977348 us; error 60 us; skew 500 ppm
Aug 08 14:36:04 dist-test-slave-8n49 krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:04.980001 28584 init.cc:377] Logged in from keytab as oryx/127.20.81.3@KRBTEST.COM (short username oryx)
I20260808 14:36:04.980587 28584 webserver.cc:460] Webserver started at http://127.20.81.3:35589/ using document root <none> and password file <none>
I20260808 14:36:04.980872 28584 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:04.980957 28584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:04.982590 28584 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:36:04.983174 28601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:04.983349 28584 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:04.983448 28584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "e59bf41693764b15a8140b1e00166a82"
format_stamp: "Formatted at 2026-08-08 14:36:03 on dist-test-slave-8n49"
server_key: "38594b7c8bd56c2c76e0ea360ddc665f"
server_key_iv: "d8724749e663b2d4d6f4761bf54ab7b2"
server_key_version: "encryptionkey@0"
I20260808 14:36:04.983837 28584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:04.998145 28584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:05.000181 28584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:05.000360 28584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:05.000671 28584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:05.001025 28584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:05.001081 28584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:05.001125 28584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:05.001157 28584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:05.007695 28584 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:44117
I20260808 14:36:05.007736 28720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:44117 every 8 connection(s)
I20260808 14:36:05.008132 28584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:36:05 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.61@KRBTEST.COM
Aug 08 14:36:05 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
Aug 08 14:36:05 dist-test-slave-8n49 krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199764, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.60@KRBTEST.COM
I20260808 14:36:05.017534 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 28584
I20260808 14:36:05.019721 28726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.008900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.20.81.3:36311)
0808 14:36:05.009092 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:05.009138 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:05.009838 (+ 700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:05.010138 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:05.010143 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:05.010449 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:05.010689 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.010694 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.011746 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.011747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.012664 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.012667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.013060 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.013061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.013221 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.013891 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:05.013901 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:05.015606 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:05.017771 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:05.017778 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:05.017780 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:05.018117 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:05.018407 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:05.018407 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:05.018408 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:05.018552 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:05.018893 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:05.018901 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:05.019103 (+ 202us) client_negotiation.cc:769] Sending connection context
0808 14:36:05.019225 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 14:36:05.019416 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":5,"thread_start_us":96,"threads_started":1}
I20260808 14:36:05.020084 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.008949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:36311 (local address 127.20.81.61:44229)
0808 14:36:05.009205 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.009208 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.009218 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:05.009949 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.009951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.009966 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.010018 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:05.010790 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.011655 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.012780 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.012969 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.013048 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.015701 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:05.015702 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:05.015702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:05.015710 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:05.017666 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.018217 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.018218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.018218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.018280 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.018620 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.018621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.018622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.018789 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:05.018863 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.019887 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.019972 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219}
I20260808 14:36:05.020442 28723 heartbeater.cc:347] Connected to a master server at 127.20.81.61:44229
I20260808 14:36:05.020584 28723 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:05.020800 28723 heartbeater.cc:511] Master 127.20.81.61:44229 requested a full tablet report, sending...
I20260808 14:36:05.021054 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.009311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:55645 (local address 127.20.81.62:41645)
0808 14:36:05.009392 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.009394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.009403 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:05.009965 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.009967 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.009981 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.010015 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:05.010842 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.011667 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.013570 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.013828 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.013900 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.016219 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:05.016220 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:05.016221 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:05.016231 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:05.018643 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.019063 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.019064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.019064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.019129 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.019347 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.019348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.019348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.019486 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:05.019571 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.020084 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.020931 (+ 847us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:36:05.021250 28045 ts_manager.cc:194] Registered new tserver with Master: e59bf41693764b15a8140b1e00166a82 (127.20.81.3:44117)
I20260808 14:36:05.021682 28439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.008890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:51777 (local address 127.20.81.60:46303)
0808 14:36:05.008950 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.008952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.009423 (+ 471us) server_negotiation.cc:407] Connection header received
0808 14:36:05.009966 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.009967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.009986 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.010018 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:05.010811 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.011324 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.012764 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.013096 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.013174 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.016795 (+ 3621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:05.016796 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:05.016796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:05.016810 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:05.018558 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.020764 (+ 2206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.020765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.020766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.020831 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.021073 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.021074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.021075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.021233 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:05.021289 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.021500 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.021587 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:36:05.022936 28727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.009222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.3:55645)
0808 14:36:05.009357 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:05.009367 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:05.009847 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:05.010138 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:05.010143 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:05.010679 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:05.010736 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.010738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.012632 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.012633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.013482 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.013485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.013918 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.013919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.014000 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.014412 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:05.014417 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:05.016091 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:05.018746 (+ 2655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:05.018747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:05.018748 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:05.018975 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:05.019207 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:05.019208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:05.019208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:05.019271 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:05.019602 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:05.019603 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:05.019647 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:36:05.019715 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:36:05.020714 (+ 999us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260808 14:36:05.023069 28725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.008900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.20.81.3:51777)
0808 14:36:05.009292 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:05.009302 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:05.009847 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:05.010138 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:05.010143 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:05.010473 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:05.010689 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.010695 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.011429 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.011430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.012664 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.012667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.013177 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.013178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.013232 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.014507 (+ 1275us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:05.014512 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:05.016699 (+ 2187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:05.020396 (+ 3697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:05.020397 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:05.020397 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:05.020662 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:05.020917 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:05.020918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:05.020918 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:05.020980 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:05.021329 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:05.021331 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:05.021377 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:36:05.021445 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:36:05.021557 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":56,"thread_start_us":79,"threads_started":1}
I20260808 14:36:05.023437 28721 heartbeater.cc:347] Connected to a master server at 127.20.81.60:46303
I20260808 14:36:05.023484 28721 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:05.023551 28722 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41645
I20260808 14:36:05.023559 28721 heartbeater.cc:511] Master 127.20.81.60:46303 requested a full tablet report, sending...
I20260808 14:36:05.023620 28722 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:05.023689 28722 heartbeater.cc:511] Master 127.20.81.62:41645 requested a full tablet report, sending...
I20260808 14:36:05.023895 28243 ts_manager.cc:194] Registered new tserver with Master: e59bf41693764b15a8140b1e00166a82 (127.20.81.3:44117)
I20260808 14:36:05.023914 27408 ts_manager.cc:194] Re-registered known tserver with Master: e59bf41693764b15a8140b1e00166a82 (127.20.81.3:44117)
I20260808 14:36:05.024365 27408 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:55645
I20260808 14:36:05.030145 28733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.018851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55300 (local address 127.20.81.62:41645)
0808 14:36:05.019169 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.019171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.019179 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:36:05.019203 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.019203 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.019215 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.019277 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:05.021857 (+ 2580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.022730 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.024676 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.024941 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.025029 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.026812 (+ 1783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:05.026814 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:05.026814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:05.026822 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:05.028666 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.029101 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.029102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.029103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.029165 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.029390 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.029391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.029391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.029539 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:05.029653 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.029926 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.030015 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":89,"threads_started":1}
I20260808 14:36:05.030421 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.019215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54666 (local address 127.20.81.61:44229)
0808 14:36:05.020364 (+ 1149us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.020366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.021668 (+ 1302us) server_negotiation.cc:407] Connection header received
0808 14:36:05.021760 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.021761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.021770 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.021794 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:05.023359 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.024033 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.025366 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.025575 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.025657 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.027142 (+ 1485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:05.027144 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:05.027144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:05.027151 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:05.028938 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.029418 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.029419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.029419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.029480 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.029747 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.029748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.029748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.029881 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:05.029962 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.030167 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.030330 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1134,"thread_start_us":62,"threads_started":1}
I20260808 14:36:05.030669 28735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.019456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51148 (local address 127.20.81.60:46303)
0808 14:36:05.019803 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.019806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.019984 (+ 178us) server_negotiation.cc:407] Connection header received
0808 14:36:05.020009 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.020011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.020024 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.020095 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:05.020808 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.021499 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.025317 (+ 3818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.025637 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.025693 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.027268 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:05.027269 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:05.027270 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:05.027276 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:05.029003 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.029436 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.029437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.029438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.029489 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.029709 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.029710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.029711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.029847 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:05.029982 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.030430 (+ 448us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.030552 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":61,"threads_started":1}
I20260808 14:36:05.031913 27408 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55300:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:05.033562 27408 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:05.034255 28006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: NON_VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: true } } }
I20260808 14:36:05.034366 28006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:05.036310 28005 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: attempting to promote NON_VOTER 0c13e564f70e493db9921d85660ad308 to VOTER
I20260808 14:36:05.036474 28005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } }
I20260808 14:36:05.036903 28057 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Refusing update from remote peer 6ad6bbdae9114e269066d0d8315fcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 14:36:05.036895 28253 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 LEARNER]: Refusing update from remote peer 6ad6bbdae9114e269066d0d8315fcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 14:36:05.037096 28006 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 14:36:05.037227 28203 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 14:36:05.038079 28005 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 0c13e564f70e493db9921d85660ad308 (127.20.81.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:05.038172 28057 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 0c13e564f70e493db9921d85660ad308 (127.20.81.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:05.038168 28253 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 0c13e564f70e493db9921d85660ad308 (127.20.81.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:05.039103 28005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:05.039196 28005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:05.039146 28202 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:05.039249 28202 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:05.039278 28005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:05.039278 28283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:05.039355 28283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:05.039348 28005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:05.039358 28203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ad6bbdae9114e269066d0d8315fcb63" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:05.039454 28203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:05.043983 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.039844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:46085 (local address 127.0.0.1:45522)
0808 14:36:05.039895 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:05.039908 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:05.039950 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:05.040760 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:05.040761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:05.040763 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:05.040827 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.040829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.042203 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.042205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.042935 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.042937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.043762 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.043763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.043829 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.043833 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:05.043863 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 14:36:05.043906 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":16}
I20260808 14:36:05.044463 28749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.039952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45522 (local address 127.20.81.2:46085)
0808 14:36:05.040515 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.040520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.040531 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:36:05.040629 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.040632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.040649 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.040909 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:05.040976 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.042095 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.043047 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.043662 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.044188 (+ 526us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.044294 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.044323 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.044364 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":106,"threads_started":1}
I20260808 14:36:05.044607 28747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.039890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:44117 (local address 127.0.0.1:41792)
0808 14:36:05.040326 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:05.040337 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:05.040391 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:05.040673 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:05.040674 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:05.040677 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:05.040736 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.040738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.041991 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.041992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.043300 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.043303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.044322 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.044323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.044385 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.044389 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:05.044439 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:36:05.044485 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":89,"threads_started":1}
I20260808 14:36:05.044852 28750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.040138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41792 (local address 127.20.81.3:44117)
0808 14:36:05.040393 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.040398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.040435 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:36:05.040481 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.040482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.040500 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.040674 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:05.040800 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.041890 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.043396 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.044153 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.044217 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.044284 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.044699 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.044750 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":93,"threads_started":1}
I20260808 14:36:05.044890 28748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.039906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:44465 (local address 127.0.0.1:60222)
0808 14:36:05.040430 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:05.040442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:05.040487 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:05.040848 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:05.040849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:05.040851 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:05.040900 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.040902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.042174 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.042175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.043408 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.043410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.044451 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.044452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.044523 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.044530 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:36:05.044769 (+ 239us) client_negotiation.cc:240] Negotiation successful
0808 14:36:05.044823 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":31,"thread_start_us":77,"threads_started":1}
I20260808 14:36:05.045234 28751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.040217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60222 (local address 127.20.81.1:44465)
0808 14:36:05.040683 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.040687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.040696 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:05.040735 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.040737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.040753 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.040976 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:05.041042 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.042088 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.043477 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.044348 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.044437 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.044527 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.045116 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.045166 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":107,"threads_started":1}
I20260808 14:36:05.045279 28510 tablet_service.cc:1467] Processing CreateTablet for tablet 4cc04e1c45ba45eb876e784ab8d3fd2d (DEFAULT_TABLE table=test-table [id=829dcab14eba4a89842ba1ccd7620c89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:05.045698 28510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cc04e1c45ba45eb876e784ab8d3fd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:05.045946 28363 tablet_service.cc:1467] Processing CreateTablet for tablet 4cc04e1c45ba45eb876e784ab8d3fd2d (DEFAULT_TABLE table=test-table [id=829dcab14eba4a89842ba1ccd7620c89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:05.046317 28363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cc04e1c45ba45eb876e784ab8d3fd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:05.049293 28654 tablet_service.cc:1467] Processing CreateTablet for tablet 4cc04e1c45ba45eb876e784ab8d3fd2d (DEFAULT_TABLE table=test-table [id=829dcab14eba4a89842ba1ccd7620c89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:05.049398 28753 tablet_bootstrap.cc:492] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: Bootstrap starting.
I20260808 14:36:05.049664 28654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cc04e1c45ba45eb876e784ab8d3fd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:05.050060 28753 tablet_bootstrap.cc:654] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:05.050413 28753 log.cc:824] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:05.051218 28753 tablet_bootstrap.cc:492] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: No bootstrap required, opened a new log
I20260808 14:36:05.051267 28753 ts_tablet_manager.cc:1397] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:36:05.052495 28756 tablet_bootstrap.cc:492] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: Bootstrap starting.
I20260808 14:36:05.052875 28754 tablet_bootstrap.cc:492] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: Bootstrap starting.
I20260808 14:36:05.053192 28756 tablet_bootstrap.cc:654] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:05.053422 28753 raft_consensus.cc:348] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } }
I20260808 14:36:05.053557 28754 tablet_bootstrap.cc:654] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:05.053539 28756 log.cc:824] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:05.053593 28753 raft_consensus.cc:374] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:05.053642 28753 raft_consensus.cc:729] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d96d6691b0e48d6b151abc4b0a4377b, State: Initialized, Role: FOLLOWER
I20260808 14:36:05.053771 28753 consensus_queue.cc:260] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } }
I20260808 14:36:05.053939 28754 log.cc:824] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:05.054109 28753 ts_tablet_manager.cc:1428] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:36:05.054222 28578 heartbeater.cc:503] Master 127.20.81.62:41645 was elected leader, sending a full tablet report...
I20260808 14:36:05.054468 28756 tablet_bootstrap.cc:492] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: No bootstrap required, opened a new log
I20260808 14:36:05.054548 28756 ts_tablet_manager.cc:1397] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:36:05.054816 28754 tablet_bootstrap.cc:492] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: No bootstrap required, opened a new log
I20260808 14:36:05.054888 28754 ts_tablet_manager.cc:1397] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:36:05.056314 28754 raft_consensus.cc:348] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } }
I20260808 14:36:05.056478 28754 raft_consensus.cc:374] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:05.056515 28754 raft_consensus.cc:729] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395a5392b7394c729a8614b18e333444, State: Initialized, Role: FOLLOWER
I20260808 14:36:05.056689 28756 raft_consensus.cc:348] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } }
I20260808 14:36:05.056835 28756 raft_consensus.cc:374] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:05.056882 28756 raft_consensus.cc:729] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e59bf41693764b15a8140b1e00166a82, State: Initialized, Role: FOLLOWER
I20260808 14:36:05.057044 28756 consensus_queue.cc:260] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } }
I20260808 14:36:05.057206 28754 consensus_queue.cc:260] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } }
I20260808 14:36:05.057387 28756 ts_tablet_manager.cc:1428] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:36:05.057502 28754 ts_tablet_manager.cc:1428] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260808 14:36:05.057732 28434 heartbeater.cc:503] Master 127.20.81.62:41645 was elected leader, sending a full tablet report...
I20260808 14:36:05.058813 28722 heartbeater.cc:503] Master 127.20.81.62:41645 was elected leader, sending a full tablet report...
W20260808 14:36:05.098410 28580 tablet.cc:2369] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:36:05.193370 28761 raft_consensus.cc:482] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:05.193524 28761 raft_consensus.cc:504] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } }
I20260808 14:36:05.193957 28761 leader_election.cc:288] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d96d6691b0e48d6b151abc4b0a4377b (127.20.81.2:46085), 395a5392b7394c729a8614b18e333444 (127.20.81.1:44465)
I20260808 14:36:05.196841 28751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.194357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:34213 (local address 127.20.81.1:44465)
0808 14:36:05.194402 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.194404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.194411 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:05.194439 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.194439 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.194456 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.194519 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:05.194670 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.195151 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.196112 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.196467 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.196547 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.196558 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.196730 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.196769 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:36:05.196869 28725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.194128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:46085 (local address 127.20.81.3:50153)
0808 14:36:05.194258 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:05.194268 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:05.194324 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:05.194515 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:05.194516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:05.194518 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:05.194610 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.194611 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.195237 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.195238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.196010 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.196012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.196579 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.196580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.196669 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.196672 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:36:05.196736 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:36:05.196775 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":111}
I20260808 14:36:05.196853 28749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.194235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:50153 (local address 127.20.81.2:46085)
0808 14:36:05.194290 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.194292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.194306 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:36:05.194405 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.194406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.194424 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.194507 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:05.194681 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.195157 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.196103 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.196455 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.196574 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.196586 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.196742 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.196782 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:36:05.197096 28727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.194127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:44465 (local address 127.20.81.3:34213)
0808 14:36:05.194199 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:05.194212 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:05.194327 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:05.194523 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:05.194524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:05.194525 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:05.194602 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.194603 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.195233 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.195234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.196000 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:05.196002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.196568 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.196569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:05.196651 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.196654 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:36:05.196720 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:36:05.196761 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:36:05.197333 28531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cc04e1c45ba45eb876e784ab8d3fd2d" candidate_uuid: "e59bf41693764b15a8140b1e00166a82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" is_pre_election: true
I20260808 14:36:05.197508 28531 raft_consensus.cc:2454] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e59bf41693764b15a8140b1e00166a82 in term 0.
I20260808 14:36:05.197466 28383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cc04e1c45ba45eb876e784ab8d3fd2d" candidate_uuid: "e59bf41693764b15a8140b1e00166a82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395a5392b7394c729a8614b18e333444" is_pre_election: true
I20260808 14:36:05.197625 28383 raft_consensus.cc:2454] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e59bf41693764b15a8140b1e00166a82 in term 0.
I20260808 14:36:05.197733 28606 leader_election.cc:302] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d96d6691b0e48d6b151abc4b0a4377b, e59bf41693764b15a8140b1e00166a82; no voters:
I20260808 14:36:05.197860 28761 raft_consensus.cc:2781] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:05.197914 28761 raft_consensus.cc:482] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:05.197945 28761 raft_consensus.cc:3037] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Advancing to term 1
W20260808 14:36:05.198313 28436 tablet.cc:2369] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:36:05.198742 28761 raft_consensus.cc:504] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } }
I20260808 14:36:05.198899 28761 leader_election.cc:288] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [CANDIDATE]: Term 1 election: Requested vote from peers 3d96d6691b0e48d6b151abc4b0a4377b (127.20.81.2:46085), 395a5392b7394c729a8614b18e333444 (127.20.81.1:44465)
I20260808 14:36:05.199043 28383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cc04e1c45ba45eb876e784ab8d3fd2d" candidate_uuid: "e59bf41693764b15a8140b1e00166a82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395a5392b7394c729a8614b18e333444"
I20260808 14:36:05.199039 28531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cc04e1c45ba45eb876e784ab8d3fd2d" candidate_uuid: "e59bf41693764b15a8140b1e00166a82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d96d6691b0e48d6b151abc4b0a4377b"
I20260808 14:36:05.199149 28531 raft_consensus.cc:3037] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:05.199149 28383 raft_consensus.cc:3037] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:05.200048 28383 raft_consensus.cc:2454] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e59bf41693764b15a8140b1e00166a82 in term 1.
I20260808 14:36:05.200048 28531 raft_consensus.cc:2454] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e59bf41693764b15a8140b1e00166a82 in term 1.
I20260808 14:36:05.200273 28602 leader_election.cc:302] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 395a5392b7394c729a8614b18e333444, e59bf41693764b15a8140b1e00166a82; no voters:
I20260808 14:36:05.200387 28761 raft_consensus.cc:2781] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:05.200584 28761 raft_consensus.cc:686] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 1 LEADER]: Becoming Leader. State: Replica: e59bf41693764b15a8140b1e00166a82, State: Running, Role: LEADER
I20260808 14:36:05.200680 28761 consensus_queue.cc:237] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } }
I20260808 14:36:05.201723 27408 catalog_manager.cc:5495] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 reported cstate change: term changed from 0 to 1, leader changed from <none> to e59bf41693764b15a8140b1e00166a82 (127.20.81.3). New cstate: current_term: 1 leader_uuid: "e59bf41693764b15a8140b1e00166a82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:05.225948 28750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.223400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41794 (local address 127.20.81.3:44117)
0808 14:36:05.223447 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.223449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.223458 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:05.223502 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.223502 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.223522 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.223598 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:05.223755 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.224282 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.225142 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.225347 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.225420 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.225600 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:05.225704 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:05.225797 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.225816 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.225840 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:36:05.228083 28383 raft_consensus.cc:1261] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [term 1 FOLLOWER]: Refusing update from remote peer e59bf41693764b15a8140b1e00166a82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:05.228106 28531 raft_consensus.cc:1261] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [term 1 FOLLOWER]: Refusing update from remote peer e59bf41693764b15a8140b1e00166a82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:05.228478 28763 consensus_queue.cc:1035] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:05.228639 28761 consensus_queue.cc:1035] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:05.233621 28767 mvcc.cc:205] Tried to move back new op lower bound from 7316274238370709504 to 7316274238262538240. Current Snapshot: MvccSnapshot[applied={T|T < 7316274238370709504 or (T in {7316274238370709504})}]
I20260808 14:36:05.234387 27407 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:05.234493 27407 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:05.236152 27407 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ad6bbdae9114e269066d0d8315fcb63: Sending DeleteTablet for 3 replicas of tablet 4cc04e1c45ba45eb876e784ab8d3fd2d
I20260808 14:36:05.236469 28363 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cc04e1c45ba45eb876e784ab8d3fd2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:05 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:60222
I20260808 14:36:05.236521 28654 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cc04e1c45ba45eb876e784ab8d3fd2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:05 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:41792
I20260808 14:36:05.236639 28510 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cc04e1c45ba45eb876e784ab8d3fd2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:05 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:45522
I20260808 14:36:05.236742 28777 tablet_replica.cc:330] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: stopping tablet replica
I20260808 14:36:05.236840 28777 raft_consensus.cc:2229] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:05.236930 28778 tablet_replica.cc:330] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: stopping tablet replica
I20260808 14:36:05.236948 28777 raft_consensus.cc:2258] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:05.237107 28778 raft_consensus.cc:2229] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:05.237270 28778 raft_consensus.cc:2258] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:05.237438 28777 ts_tablet_manager.cc:1905] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:05.237835 28778 ts_tablet_manager.cc:1905] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:05.238240 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 27373
I20260808 14:36:05.239356 28777 ts_tablet_manager.cc:1918] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:05.239432 28777 log.cc:1196] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/4cc04e1c45ba45eb876e784ab8d3fd2d
I20260808 14:36:05.239739 28777 ts_tablet_manager.cc:1939] T 4cc04e1c45ba45eb876e784ab8d3fd2d P e59bf41693764b15a8140b1e00166a82: Deleting consensus metadata
I20260808 14:36:05.240742 28778 ts_tablet_manager.cc:1918] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:05.240832 28778 log.cc:1196] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/4cc04e1c45ba45eb876e784ab8d3fd2d
I20260808 14:36:05.241084 28778 ts_tablet_manager.cc:1939] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 3d96d6691b0e48d6b151abc4b0a4377b: Deleting consensus metadata
I20260808 14:36:05.247938 28735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.237539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51152 (local address 127.20.81.60:46303)
0808 14:36:05.237580 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.237582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.241302 (+ 3720us) server_negotiation.cc:407] Connection header received
0808 14:36:05.241415 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.241416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.241433 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.241465 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:05.242113 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.242618 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.243343 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.243554 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.243637 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.245334 (+ 1697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:05.245335 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:05.245336 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:05.245344 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:05.246769 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.247139 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.247140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.247140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.247202 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.247399 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.247400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.247401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.247517 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:05.247629 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.247737 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.247826 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:36:05.248721 28776 tablet_replica.cc:330] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: stopping tablet replica
I20260808 14:36:05.248879 28776 raft_consensus.cc:2229] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:05.249037 28776 raft_consensus.cc:2258] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 14:36:05.249521 28460 connection.cc:535] server connection from 127.0.0.1:45522 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:36:05.249609 28776 ts_tablet_manager.cc:1905] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 14:36:05.249634 28603 connection.cc:535] server connection from 127.0.0.1:41792 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:36:05.251402 28776 ts_tablet_manager.cc:1918] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:05.251490 28776 log.cc:1196] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/4cc04e1c45ba45eb876e784ab8d3fd2d
I20260808 14:36:05.251803 28776 ts_tablet_manager.cc:1939] T 4cc04e1c45ba45eb876e784ab8d3fd2d P 395a5392b7394c729a8614b18e333444: Deleting consensus metadata
W20260808 14:36:05.252214 28316 connection.cc:441] server connection from 127.0.0.1:60222 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60222 (request call id 1) could send its response
I20260808 14:36:05.259351 28735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.252069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51160 (local address 127.20.81.60:46303)
0808 14:36:05.252108 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.252110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.252381 (+ 271us) server_negotiation.cc:407] Connection header received
0808 14:36:05.252522 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.252524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.252534 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.252603 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:05.253394 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.254148 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.254936 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.255146 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.255215 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.256443 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:05.256445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:05.256445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:05.256453 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:05.258126 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.258581 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.258582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.258582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.258642 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.258815 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.258816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.258816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.258954 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:05.259062 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.259170 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.259249 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:36:05.259533 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:05.251796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54676 (local address 127.20.81.61:44229)
0808 14:36:05.251844 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:05.251846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:05.252168 (+ 322us) server_negotiation.cc:407] Connection header received
0808 14:36:05.252260 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:05.252262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:05.252275 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:05.252346 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:05.253086 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.253711 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.254583 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:05.254893 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:05.254960 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:05.256606 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:05.256607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:05.256608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:05.256615 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:05.258262 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.258654 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.258655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.258655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.258717 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:05.258884 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:05.258886 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:05.258886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:05.259028 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:05.259136 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:05.259320 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 14:36:05.259412 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:36:06.234270 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.233932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.3:34813)
0808 14:36:06.234120 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.234212 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":103,"threads_started":1}
I20260808 14:36:06.234310 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.234059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.2:34287)
0808 14:36:06.234164 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.234241 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":48,"threads_started":1}
W20260808 14:36:06.234650 28578 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:41645 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
I20260808 14:36:06.234802 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.234419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.1:44743)
0808 14:36:06.234668 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.234759 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":58,"threads_started":1}
W20260808 14:36:06.235122 28722 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:41645 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
W20260808 14:36:06.235266 28434 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:41645 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
I20260808 14:36:06.736315 28791 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ad6bbdae9114e269066d0d8315fcb63)
I20260808 14:36:06.736459 28791 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } }
I20260808 14:36:06.736739 28792 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ad6bbdae9114e269066d0d8315fcb63)
I20260808 14:36:06.736845 28791 leader_election.cc:288] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ad6bbdae9114e269066d0d8315fcb63 (127.20.81.62:41645), ecfbba2f18a84213bb37107d003e71cb (127.20.81.61:44229)
I20260808 14:36:06.736881 28792 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } }
I20260808 14:36:06.737227 28793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.736982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55146)
0808 14:36:06.737113 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.737182 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":46,"threads_started":1}
W20260808 14:36:06.737356 28228 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
I20260808 14:36:06.737483 28792 leader_election.cc:288] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ad6bbdae9114e269066d0d8315fcb63 (127.20.81.62:41645), 0c13e564f70e493db9921d85660ad308 (127.20.81.60:46303)
I20260808 14:36:06.737721 28799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.737471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55162)
0808 14:36:06.737627 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.737682 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":46,"threads_started":1}
W20260808 14:36:06.737833 28031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
I20260808 14:36:06.737963 28793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.737840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55164)
0808 14:36:06.737894 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.737927 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 14:36:06.738057 28228 leader_election.cc:334] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6ad6bbdae9114e269066d0d8315fcb63 (127.20.81.62:41645): Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
I20260808 14:36:06.738281 28799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.738191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55176)
0808 14:36:06.738229 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.738259 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 14:36:06.738365 28031 leader_election.cc:334] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6ad6bbdae9114e269066d0d8315fcb63 (127.20.81.62:41645): Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
I20260808 14:36:06.740620 28795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.737222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44284 (local address 127.20.81.61:44229)
0808 14:36:06.737574 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:06.737576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:06.737587 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:36:06.737686 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:06.737687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:06.737698 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:06.737753 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:06.738179 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.738784 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.739852 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.740225 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.740316 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.740329 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:06.740465 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:36:06.740507 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":334,"thread_start_us":50,"threads_started":1}
I20260808 14:36:06.740633 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.737520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40756 (local address 127.20.81.60:46303)
0808 14:36:06.737668 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:06.737670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:06.737677 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:06.737941 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:06.737942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:06.737954 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:06.738004 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:06.738364 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.738879 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.739879 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.740250 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.740340 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.740352 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:06.740486 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 14:36:06.740525 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
I20260808 14:36:06.740660 28794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.737152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44229 (local address 127.0.0.1:44284)
0808 14:36:06.737264 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.737275 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:06.737591 (+ 316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:06.737898 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:06.737899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:06.737902 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:06.737975 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.737978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.738869 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.738870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.739768 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.739770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.740320 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.740321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.740382 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.740386 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:06.740456 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 14:36:06.740497 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":61,"threads_started":1}
I20260808 14:36:06.740887 28057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c13e564f70e493db9921d85660ad308" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ecfbba2f18a84213bb37107d003e71cb" is_pre_election: true
I20260808 14:36:06.740993 28057 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c13e564f70e493db9921d85660ad308 in term 1.
I20260808 14:36:06.741034 28797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.737284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46303 (local address 127.0.0.1:40756)
0808 14:36:06.737375 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.737386 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:06.737720 (+ 334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:06.738177 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:06.738178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:06.738180 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:06.738253 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.738256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.738965 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.738966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.739792 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.739795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.740346 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.740347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.740413 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.740416 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:36:06.740480 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:36:06.740523 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":5,"thread_start_us":51,"threads_started":1}
I20260808 14:36:06.741201 28228 leader_election.cc:302] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c13e564f70e493db9921d85660ad308, ecfbba2f18a84213bb37107d003e71cb; no voters: 6ad6bbdae9114e269066d0d8315fcb63
I20260808 14:36:06.741298 28791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 14:36:06.741338 28791 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ad6bbdae9114e269066d0d8315fcb63)
I20260808 14:36:06.741366 28791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:36:06.741317 28253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ecfbba2f18a84213bb37107d003e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0c13e564f70e493db9921d85660ad308" is_pre_election: true
I20260808 14:36:06.742107 28791 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } }
I20260808 14:36:06.742236 28253 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecfbba2f18a84213bb37107d003e71cb in current term 2: Already voted for candidate 0c13e564f70e493db9921d85660ad308 in this term.
I20260808 14:36:06.742244 28791 leader_election.cc:288] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [CANDIDATE]: Term 2 election: Requested vote from peers 6ad6bbdae9114e269066d0d8315fcb63 (127.20.81.62:41645), ecfbba2f18a84213bb37107d003e71cb (127.20.81.61:44229)
I20260808 14:36:06.742451 28032 leader_election.cc:302] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfbba2f18a84213bb37107d003e71cb; no voters: 0c13e564f70e493db9921d85660ad308, 6ad6bbdae9114e269066d0d8315fcb63
I20260808 14:36:06.742547 28794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.742411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55192)
0808 14:36:06.742492 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.742518 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 14:36:06.742606 28792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:36:06.742570 28057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c13e564f70e493db9921d85660ad308" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ecfbba2f18a84213bb37107d003e71cb"
I20260808 14:36:06.742831 28794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.742746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55198)
0808 14:36:06.742788 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.742816 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 14:36:06.742892 28228 leader_election.cc:334] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6ad6bbdae9114e269066d0d8315fcb63 (127.20.81.62:41645): Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
I20260808 14:36:06.743266 28792 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:36:06.743916 28057 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c13e564f70e493db9921d85660ad308 in term 2.
I20260808 14:36:06.744091 28228 leader_election.cc:302] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c13e564f70e493db9921d85660ad308, ecfbba2f18a84213bb37107d003e71cb; no voters: 6ad6bbdae9114e269066d0d8315fcb63
I20260808 14:36:06.744202 28791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:36:06.744343 28791 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [term 2 LEADER]: Becoming Leader. State: Replica: 0c13e564f70e493db9921d85660ad308, State: Running, Role: LEADER
I20260808 14:36:06.744416 28791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } }
I20260808 14:36:06.744769 28802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c13e564f70e493db9921d85660ad308. Latest consensus state: current_term: 2 leader_uuid: "0c13e564f70e493db9921d85660ad308" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:06.744865 28802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:06.745049 28804 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:06.745529 28804 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:06.745596 28804 catalog_manager.cc:1259] Loaded cluster ID: 10bad0bf1b2043fb95d063a3b70eb8e2
I20260808 14:36:06.745618 28804 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:06.745728 28804 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:06.745790 28804 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Loaded TSK: 0
I20260808 14:36:06.745883 28804 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:36:06.801693 28242 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51160:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:06.803339 28242 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:06.804479 28057 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [term 2 FOLLOWER]: Refusing update from remote peer 0c13e564f70e493db9921d85660ad308: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 14:36:06.804498 28794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.804375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55210)
0808 14:36:06.804434 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.804464 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 14:36:06.805006 28791 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 14:36:06.805137 28794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.805023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.0.0.1:55226)
0808 14:36:06.805076 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.805103 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 14:36:06.805243 28228 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 -> Peer 6ad6bbdae9114e269066d0d8315fcb63 (127.20.81.62:41645): Couldn't send request to peer 6ad6bbdae9114e269066d0d8315fcb63. Status: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:36:06.805680 28792 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c13e564f70e493db9921d85660ad308. Latest consensus state: current_term: 2 leader_uuid: "0c13e564f70e493db9921d85660ad308" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:06.805776 28792 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:06.806063 28805 mvcc.cc:205] Tried to move back new op lower bound from 7316274244828831744 to 7316274244585857024. Current Snapshot: MvccSnapshot[applied={T|T < 7316274244828831744}]
I20260808 14:36:06.806200 28791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "0c13e564f70e493db9921d85660ad308" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:06.806299 28791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:06.806413 28792 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "0c13e564f70e493db9921d85660ad308" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ad6bbdae9114e269066d0d8315fcb63" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41645 } } peers { permanent_uuid: "ecfbba2f18a84213bb37107d003e71cb" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44229 } attrs { promote: false } } peers { permanent_uuid: "0c13e564f70e493db9921d85660ad308" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46303 } attrs { promote: false } } }
I20260808 14:36:06.806538 28792 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfbba2f18a84213bb37107d003e71cb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:06.806669 28806 mvcc.cc:205] Tried to move back new op lower bound from 7316274244828831744 to 7316274244585857024. Current Snapshot: MvccSnapshot[applied={T|T < 7316274244828831744}]
I20260808 14:36:06.811342 28794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.807971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:44465 (local address 127.0.0.1:43568)
0808 14:36:06.808077 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.808088 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:06.808132 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:06.808374 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:06.808375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:06.808377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:06.808432 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.808434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.809268 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.809269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.810379 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.810382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.811119 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.811120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.811179 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.811183 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:06.811234 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:36:06.811274 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 14:36:06.811353 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.808085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43568 (local address 127.20.81.1:44465)
0808 14:36:06.808219 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:06.808221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:06.808227 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:36:06.808273 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:06.808274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:06.808287 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:06.808353 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:06.808513 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.809179 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.810482 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.811041 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.811122 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.811136 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:06.811247 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 14:36:06.811284 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
I20260808 14:36:06.811573 28793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.807971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:44117 (local address 127.0.0.1:60822)
0808 14:36:06.808129 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.808143 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:06.808196 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:06.808665 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:06.808665 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:06.808668 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:06.808704 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.808705 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.809656 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.809657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.810627 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.810630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.811351 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.811352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.811423 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.811427 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:06.811460 (+ 33us) client_negotiation.cc:240] Negotiation successful
0808 14:36:06.811505 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":55}
I20260808 14:36:06.811786 28810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.808016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:46085 (local address 127.0.0.1:36626)
0808 14:36:06.808488 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.808498 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:06.808546 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:06.808746 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:06.808747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:06.808748 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:06.808776 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.808777 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.809678 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.809679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.810792 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.810794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.811539 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.811540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.811610 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.811615 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:36:06.811667 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:36:06.811715 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":22,"thread_start_us":78,"threads_started":1}
I20260808 14:36:06.811908 28811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.808035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60822 (local address 127.20.81.3:44117)
0808 14:36:06.808292 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:06.808294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:06.808301 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:06.808326 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:06.808326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:06.808336 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:06.808767 (+ 431us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:06.808810 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.809549 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.810690 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.811250 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.811734 (+ 484us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.811749 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:06.811768 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 14:36:06.811816 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":57,"threads_started":1}
I20260808 14:36:06.811975 28363 tablet_service.cc:1467] Processing CreateTablet for tablet b737b0a35c174c778522ede23d741105 (DEFAULT_TABLE table=test-table [id=568a290c3f4c407aa08c65650118c8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:06.812119 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.808199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36626 (local address 127.20.81.2:46085)
0808 14:36:06.808322 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:06.808324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:06.808538 (+ 214us) server_negotiation.cc:407] Connection header received
0808 14:36:06.808635 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:06.808636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:06.808647 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:06.808701 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:06.808847 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.809601 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.810875 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.811439 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.811498 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.811509 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:06.811924 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 14:36:06.812070 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":54,"threads_started":1}
I20260808 14:36:06.812105 28654 tablet_service.cc:1467] Processing CreateTablet for tablet b737b0a35c174c778522ede23d741105 (DEFAULT_TABLE table=test-table [id=568a290c3f4c407aa08c65650118c8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:06.812134 28363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b737b0a35c174c778522ede23d741105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:06.812211 28654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b737b0a35c174c778522ede23d741105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:06.812306 28510 tablet_service.cc:1467] Processing CreateTablet for tablet b737b0a35c174c778522ede23d741105 (DEFAULT_TABLE table=test-table [id=568a290c3f4c407aa08c65650118c8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:06.812417 28510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b737b0a35c174c778522ede23d741105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:06.813670 28814 tablet_bootstrap.cc:492] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: Bootstrap starting.
I20260808 14:36:06.813977 28817 tablet_bootstrap.cc:492] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444: Bootstrap starting.
I20260808 14:36:06.814090 28814 tablet_bootstrap.cc:654] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:06.814368 28817 tablet_bootstrap.cc:654] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:06.814685 28815 tablet_bootstrap.cc:492] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: Bootstrap starting.
I20260808 14:36:06.814698 28814 tablet_bootstrap.cc:492] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: No bootstrap required, opened a new log
I20260808 14:36:06.814747 28814 ts_tablet_manager.cc:1397] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:06.814898 28814 raft_consensus.cc:348] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } }
I20260808 14:36:06.814986 28814 raft_consensus.cc:374] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:06.815016 28814 raft_consensus.cc:729] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d96d6691b0e48d6b151abc4b0a4377b, State: Initialized, Role: FOLLOWER
I20260808 14:36:06.815009 28815 tablet_bootstrap.cc:654] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:06.815090 28814 consensus_queue.cc:260] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } }
I20260808 14:36:06.815129 28817 tablet_bootstrap.cc:492] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444: No bootstrap required, opened a new log
I20260808 14:36:06.815171 28817 ts_tablet_manager.cc:1397] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:06.815254 28814 ts_tablet_manager.cc:1428] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:06.815361 28817 raft_consensus.cc:348] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } }
I20260808 14:36:06.815456 28817 raft_consensus.cc:374] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:06.815481 28817 raft_consensus.cc:729] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395a5392b7394c729a8614b18e333444, State: Initialized, Role: FOLLOWER
I20260808 14:36:06.815536 28815 tablet_bootstrap.cc:492] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: No bootstrap required, opened a new log
I20260808 14:36:06.815526 28817 consensus_queue.cc:260] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } }
I20260808 14:36:06.815577 28815 ts_tablet_manager.cc:1397] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:06.815671 28817 ts_tablet_manager.cc:1428] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:06.815685 28815 raft_consensus.cc:348] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } }
I20260808 14:36:06.815755 28815 raft_consensus.cc:374] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:06.815781 28815 raft_consensus.cc:729] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e59bf41693764b15a8140b1e00166a82, State: Initialized, Role: FOLLOWER
I20260808 14:36:06.815821 28815 consensus_queue.cc:260] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } }
I20260808 14:36:06.815986 28815 ts_tablet_manager.cc:1428] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:06.816677 28577 heartbeater.cc:503] Master 127.20.81.60:46303 was elected leader, sending a full tablet report...
I20260808 14:36:06.816723 28825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.815877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.1:40229)
0808 14:36:06.816631 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.816676 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":69,"threads_started":1}
I20260808 14:36:06.816743 28433 heartbeater.cc:503] Master 127.20.81.60:46303 was elected leader, sending a full tablet report...
I20260808 14:36:06.817059 28825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.816956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.1:34223)
0808 14:36:06.816994 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.817024 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 14:36:06.817565 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.816250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.3:56057)
0808 14:36:06.817482 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.817522 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1207,"thread_start_us":77,"threads_started":1}
I20260808 14:36:06.817838 28822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.815461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.2:51427)
0808 14:36:06.817756 (+ 2295us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.817791 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2273,"thread_start_us":75,"threads_started":1}
I20260808 14:36:06.817889 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.817783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.3:58445)
0808 14:36:06.817824 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.817853 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 14:36:06.818115 28822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.818038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.2:47407)
0808 14:36:06.818070 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.818096 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 14:36:06.818423 28823 raft_consensus.cc:482] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:06.818477 28823 raft_consensus.cc:504] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } }
I20260808 14:36:06.818799 28823 leader_election.cc:288] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e59bf41693764b15a8140b1e00166a82 (127.20.81.3:44117), 3d96d6691b0e48d6b151abc4b0a4377b (127.20.81.2:46085)
I20260808 14:36:06.821702 28825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.818917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:46085 (local address 127.20.81.1:40621)
0808 14:36:06.819083 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.819092 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:06.819146 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:06.819282 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:06.819282 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:06.819284 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:06.819340 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.819341 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.820116 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.820117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.820950 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.820953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.821468 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.821469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.821544 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.821547 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:36:06.821597 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:36:06.821626 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
I20260808 14:36:06.821717 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.819062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:40621 (local address 127.20.81.2:46085)
0808 14:36:06.819103 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:06.819105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:06.819133 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:36:06.819222 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:06.819223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:06.819231 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:06.819278 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:06.819481 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.820033 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.821026 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.821394 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.821449 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.821475 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:06.821617 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:36:06.821659 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:36:06.821801 28811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.818971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:36309 (local address 127.20.81.3:44117)
0808 14:36:06.819012 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:06.819014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:06.819101 (+ 87us) server_negotiation.cc:407] Connection header received
0808 14:36:06.819198 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:06.819199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:06.819212 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:06.819262 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:06.819396 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.819987 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.821073 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.821410 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.821493 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.821503 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:06.821692 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:36:06.821735 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:36:06.821825 28827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.818885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:44117 (local address 127.20.81.1:36309)
0808 14:36:06.819044 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.819053 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:06.819128 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:06.819265 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:06.819266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:06.819267 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:06.819332 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.819333 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.820061 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.820062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.820973 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:06.820976 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.821530 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.821532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:06.821614 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.821619 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:36:06.821676 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:36:06.821714 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":24}
I20260808 14:36:06.821906 28531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b737b0a35c174c778522ede23d741105" candidate_uuid: "395a5392b7394c729a8614b18e333444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" is_pre_election: true
I20260808 14:36:06.821992 28531 raft_consensus.cc:2454] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 395a5392b7394c729a8614b18e333444 in term 0.
I20260808 14:36:06.822172 28315 leader_election.cc:302] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 395a5392b7394c729a8614b18e333444, 3d96d6691b0e48d6b151abc4b0a4377b; no voters:
I20260808 14:36:06.822206 28674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b737b0a35c174c778522ede23d741105" candidate_uuid: "395a5392b7394c729a8614b18e333444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e59bf41693764b15a8140b1e00166a82" is_pre_election: true
I20260808 14:36:06.822304 28823 raft_consensus.cc:2781] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:06.822340 28823 raft_consensus.cc:482] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:06.822333 28674 raft_consensus.cc:2454] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 395a5392b7394c729a8614b18e333444 in term 0.
I20260808 14:36:06.822372 28823 raft_consensus.cc:3037] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:06.823028 28823 raft_consensus.cc:504] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } }
I20260808 14:36:06.823237 28823 leader_election.cc:288] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [CANDIDATE]: Term 1 election: Requested vote from peers e59bf41693764b15a8140b1e00166a82 (127.20.81.3:44117), 3d96d6691b0e48d6b151abc4b0a4377b (127.20.81.2:46085)
I20260808 14:36:06.823285 28531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b737b0a35c174c778522ede23d741105" candidate_uuid: "395a5392b7394c729a8614b18e333444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d96d6691b0e48d6b151abc4b0a4377b"
I20260808 14:36:06.823323 28674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b737b0a35c174c778522ede23d741105" candidate_uuid: "395a5392b7394c729a8614b18e333444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e59bf41693764b15a8140b1e00166a82"
I20260808 14:36:06.823369 28531 raft_consensus.cc:3037] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:06.823386 28674 raft_consensus.cc:3037] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:06.824023 28674 raft_consensus.cc:2454] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 395a5392b7394c729a8614b18e333444 in term 1.
I20260808 14:36:06.824029 28531 raft_consensus.cc:2454] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 395a5392b7394c729a8614b18e333444 in term 1.
I20260808 14:36:06.824182 28313 leader_election.cc:302] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 395a5392b7394c729a8614b18e333444, e59bf41693764b15a8140b1e00166a82; no voters:
I20260808 14:36:06.824308 28823 raft_consensus.cc:2781] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:06.824492 28823 raft_consensus.cc:686] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 1 LEADER]: Becoming Leader. State: Replica: 395a5392b7394c729a8614b18e333444, State: Running, Role: LEADER
I20260808 14:36:06.824592 28823 consensus_queue.cc:237] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } }
I20260808 14:36:06.824817 28827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.824730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.1:33839)
0808 14:36:06.824760 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.824796 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 14:36:06.825350 28242 catalog_manager.cc:5495] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 reported cstate change: term changed from 0 to 1, leader changed from <none> to 395a5392b7394c729a8614b18e333444 (127.20.81.1). New cstate: current_term: 1 leader_uuid: "395a5392b7394c729a8614b18e333444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395a5392b7394c729a8614b18e333444" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:06.832831 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.830356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43574 (local address 127.20.81.1:44465)
0808 14:36:06.830518 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:06.830520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:06.830545 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:36:06.830634 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:06.830634 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:06.830654 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:06.830738 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:06.830841 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.831292 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.832031 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:06.832238 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:06.832309 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:06.832476 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:06.832619 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:06.832683 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:06.832739 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 14:36:06.832759 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260808 14:36:06.833869 28531 raft_consensus.cc:1261] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [term 1 FOLLOWER]: Refusing update from remote peer 395a5392b7394c729a8614b18e333444: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:06.833953 28674 raft_consensus.cc:1261] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [term 1 FOLLOWER]: Refusing update from remote peer 395a5392b7394c729a8614b18e333444: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:06.834149 28823 consensus_queue.cc:1035] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d96d6691b0e48d6b151abc4b0a4377b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:06.834277 28828 consensus_queue.cc:1035] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e59bf41693764b15a8140b1e00166a82" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 44117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:06.834976 28721 heartbeater.cc:503] Master 127.20.81.60:46303 was elected leader, sending a full tablet report...
I20260808 14:36:06.835263 28822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.834946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.2:43959)
0808 14:36:06.835195 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.835228 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231}
I20260808 14:36:06.835893 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.835759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.3:60983)
0808 14:36:06.835836 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.835864 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 14:36:06.836635 28833 mvcc.cc:205] Tried to move back new op lower bound from 7316274244949549056 to 7316274244914638848. Current Snapshot: MvccSnapshot[applied={T|T < 7316274244949549056}]
I20260808 14:36:06.836962 28822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.836869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.2:45079)
0808 14:36:06.836907 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.836933 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 14:36:06.837098 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.836976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.3:39183)
0808 14:36:06.837042 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.837070 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 14:36:06.838492 28827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.836866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.1:40753)
0808 14:36:06.838424 (+ 1558us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.838457 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1541}
I20260808 14:36:06.838802 28242 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:06.838819 28832 mvcc.cc:205] Tried to move back new op lower bound from 7316274244949549056 to 7316274244914638848. Current Snapshot: MvccSnapshot[applied={T|T < 7316274244949549056}]
I20260808 14:36:06.838894 28242 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:06.839372 28827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.839268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41645 (local address 127.20.81.1:40813)
0808 14:36:06.839320 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.839348 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 14:36:06.840139 28242 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c13e564f70e493db9921d85660ad308: Sending DeleteTablet for 3 replicas of tablet b737b0a35c174c778522ede23d741105
I20260808 14:36:06.840505 28654 tablet_service.cc:1514] Processing DeleteTablet for tablet b737b0a35c174c778522ede23d741105 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:06 UTC) from {username='oryx', principal='oryx/127.20.81.60@KRBTEST.COM'} at 127.0.0.1:60822
I20260808 14:36:06.840610 28363 tablet_service.cc:1514] Processing DeleteTablet for tablet b737b0a35c174c778522ede23d741105 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:06 UTC) from {username='oryx', principal='oryx/127.20.81.60@KRBTEST.COM'} at 127.0.0.1:43568
I20260808 14:36:06.840785 28843 tablet_replica.cc:330] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444: stopping tablet replica
I20260808 14:36:06.840842 28843 raft_consensus.cc:2229] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:06.840931 28843 raft_consensus.cc:2258] T b737b0a35c174c778522ede23d741105 P 395a5392b7394c729a8614b18e333444 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:06.840937 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 28200
I20260808 14:36:06.843475 28510 tablet_service.cc:1514] Processing DeleteTablet for tablet b737b0a35c174c778522ede23d741105 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:06 UTC) from {username='oryx', principal='oryx/127.20.81.60@KRBTEST.COM'} at 127.0.0.1:36626
I20260808 14:36:06.843745 28844 tablet_replica.cc:330] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: stopping tablet replica
I20260808 14:36:06.843832 28844 raft_consensus.cc:2229] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:06.843902 28844 raft_consensus.cc:2258] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:06.844238 28842 tablet_replica.cc:330] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: stopping tablet replica
I20260808 14:36:06.844304 28842 raft_consensus.cc:2229] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:06.844354 28842 raft_consensus.cc:2258] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:06.844348 28844 ts_tablet_manager.cc:1905] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:06.846467 28844 ts_tablet_manager.cc:1918] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:06.846544 28844 log.cc:1196] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/b737b0a35c174c778522ede23d741105
I20260808 14:36:06.846794 28844 ts_tablet_manager.cc:1939] T b737b0a35c174c778522ede23d741105 P 3d96d6691b0e48d6b151abc4b0a4377b: Deleting consensus metadata
I20260808 14:36:06.847199 28228 catalog_manager.cc:4841] TS 3d96d6691b0e48d6b151abc4b0a4377b (127.20.81.2:46085): tablet b737b0a35c174c778522ede23d741105 (table test-table [id=568a290c3f4c407aa08c65650118c8d7]) successfully deleted
I20260808 14:36:06.847573 28842 ts_tablet_manager.cc:1905] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:06.848943 28842 ts_tablet_manager.cc:1918] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:06.849012 28842 log.cc:1196] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/b737b0a35c174c778522ede23d741105
I20260808 14:36:06.849256 28842 ts_tablet_manager.cc:1939] T b737b0a35c174c778522ede23d741105 P e59bf41693764b15a8140b1e00166a82: Deleting consensus metadata
I20260808 14:36:06.849611 28227 catalog_manager.cc:4841] TS e59bf41693764b15a8140b1e00166a82 (127.20.81.3:44117): tablet b737b0a35c174c778522ede23d741105 (table test-table [id=568a290c3f4c407aa08c65650118c8d7]) successfully deleted
I20260808 14:36:06.851253 28810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:06.851140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:44465 (local address 127.0.0.1:43588)
0808 14:36:06.851195 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:06.851227 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:44465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:36:06.851394 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 28441
W20260808 14:36:06.851452 28226 catalog_manager.cc:4584] TS 395a5392b7394c729a8614b18e333444 (127.20.81.1:44465): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b737b0a35c174c778522ede23d741105: Network error: Client connection negotiation failed: client connection to 127.20.81.1:44465: connect: Connection refused (error 111)
I20260808 14:36:06.858705 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 28584
I20260808 14:36:06.867470 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 27907
I20260808 14:36:06.874049 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 28101
2026-08-08T14:36:06Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4741 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:06 dist-test-slave-8n49 krb5kdc[28847](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:06 dist-test-slave-8n49 krb5kdc[28847](info): set up 2 sockets
Aug 08 14:36:06 dist-test-slave-8n49 krb5kdc[28847](info): commencing operation
krb5kdc: starting...
W20260808 14:36:07.972915 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:08Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.62.keytab.
Entry for principal oryx/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.62.keytab.
I20260808 14:36:08.099444 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:46041
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.62.keytab
--principal=oryx/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:46041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:08.189913 28860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:08.190186 28860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:08.190227 28860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:08.191504 28860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:08.191581 28860 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:36:08.191606 28860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:08.191638 28860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:08.191670 28860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:08.191695 28860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:08.193461 28860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:46041
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.62.keytab
--principal=oryx/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:46041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:08.193766 28860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:08.194018 28860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:08.199321 28869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:08.199306 28866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:08.199335 28860 server_base.cc:1034] running on GCE node
W20260808 14:36:08.199306 28867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:08.199815 28860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:08.200148 28860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:08.201316 28860 hybrid_clock.cc:648] HybridClock initialized: now 1786199768201316 us; error 50 us; skew 500 ppm
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:08.203709 28860 init.cc:377] Logged in from keytab as oryx/127.20.81.62@KRBTEST.COM (short username oryx)
I20260808 14:36:08.204145 28860 webserver.cc:460] Webserver started at http://127.20.81.62:46657/ using document root <none> and password file <none>
I20260808 14:36:08.204327 28860 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:08.204366 28860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:08.204457 28860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:08.205566 28860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "8482fea0f24c431b85070dd4f7fc080b"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "5010ef97a16a47a3a9a30c79f14bc21c"
server_key_iv: "f3e44114f79f05f9aa85ce536e2a0634"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.205885 28860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "8482fea0f24c431b85070dd4f7fc080b"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "5010ef97a16a47a3a9a30c79f14bc21c"
server_key_iv: "f3e44114f79f05f9aa85ce536e2a0634"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.207181 28860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:36:08.208171 28876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:08.208346 28860 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:08.208453 28860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "8482fea0f24c431b85070dd4f7fc080b"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "5010ef97a16a47a3a9a30c79f14bc21c"
server_key_iv: "f3e44114f79f05f9aa85ce536e2a0634"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.208539 28860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:08.234030 28860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:08.236012 28860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:08.236182 28860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:08.241281 28860 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:46041
I20260808 14:36:08.241367 28944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:46041 every 8 connection(s)
I20260808 14:36:08.241726 28860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:08.242434 28945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:08.244789 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 28860
I20260808 14:36:08.244917 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:36:08.244966 28945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: Bootstrap starting.
I20260808 14:36:08.245147 20804 external_mini_cluster.cc:1428] Setting key 7a3ac5bd8b406d8983892653db61e836
I20260808 14:36:08.245728 28945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:08.246075 28945 log.cc:824] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:08.246897 28945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: No bootstrap required, opened a new log
I20260808 14:36:08.249307 28945 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8482fea0f24c431b85070dd4f7fc080b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46041 } }
I20260808 14:36:08.249454 28945 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:08.249475 28945 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8482fea0f24c431b85070dd4f7fc080b, State: Initialized, Role: FOLLOWER
I20260808 14:36:08.249645 28945 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8482fea0f24c431b85070dd4f7fc080b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46041 } }
I20260808 14:36:08.249752 28945 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:08.249785 28945 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:08.249830 28945 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:08.250546 28945 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8482fea0f24c431b85070dd4f7fc080b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46041 } }
I20260808 14:36:08.250634 28945 leader_election.cc:302] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8482fea0f24c431b85070dd4f7fc080b; no voters:
I20260808 14:36:08.250775 28945 leader_election.cc:288] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:08.250803 28951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:08.250921 28951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [term 1 LEADER]: Becoming Leader. State: Replica: 8482fea0f24c431b85070dd4f7fc080b, State: Running, Role: LEADER
I20260808 14:36:08.251006 28951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8482fea0f24c431b85070dd4f7fc080b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46041 } }
I20260808 14:36:08.251034 28945 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:08.253191 28953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8482fea0f24c431b85070dd4f7fc080b. Latest consensus state: current_term: 1 leader_uuid: "8482fea0f24c431b85070dd4f7fc080b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8482fea0f24c431b85070dd4f7fc080b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46041 } } }
I20260808 14:36:08.253556 28952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8482fea0f24c431b85070dd4f7fc080b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8482fea0f24c431b85070dd4f7fc080b" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46041 } } }
I20260808 14:36:08.253816 28952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:08.253813 28953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b [sys.catalog]: This master's current role is: LEADER
W20260808 14:36:08.254196 28965 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:36:08.254246 28965 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:36:08.254314 28968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:08.254472 28968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:08.256072 28968 catalog_manager.cc:1347] Generated new cluster ID: b46af098bc054c89ab467b4f9f73c79c
I20260808 14:36:08.256125 28968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:08.257400 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.245703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48558 (local address 127.20.81.62:46041)
0808 14:36:08.245896 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.245907 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.245943 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:36:08.246486 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.246494 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.246570 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.246743 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:08.247394 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.248893 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.249692 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.250293 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.250412 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.253792 (+ 3380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:08.253796 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:08.253796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:08.253811 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:08.255796 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.256221 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.256224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.256224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.256318 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.256545 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.256546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.256546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.256815 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:08.256978 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.257088 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.257227 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":80,"threads_started":1}
I20260808 14:36:08.267663 28968 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:08.268189 28968 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:08.271160 28968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: Generated new TSK 0
I20260808 14:36:08.271327 28968 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab.
Entry for principal oryx/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab.
I20260808 14:36:08.301898 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46041
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab
--principal=oryx/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:08.403102 28973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:08.403302 28973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:08.403326 28973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:08.404505 28973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:08.404543 28973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:08.404621 28973 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:36:08.404660 28973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:36:08.406159 28973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab
--principal=oryx/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.81.62:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:08.406404 28973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:08.406647 28973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:08.411576 28981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:08.411594 28983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:08.411590 28980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:08.412312 28973 server_base.cc:1034] running on GCE node
I20260808 14:36:08.412539 28973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:08.412845 28973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:08.413995 28973 hybrid_clock.cc:648] HybridClock initialized: now 1786199768413984 us; error 28 us; skew 500 ppm
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:08.416747 28973 init.cc:377] Logged in from keytab as oryx/127.20.81.1@KRBTEST.COM (short username oryx)
I20260808 14:36:08.417305 28973 webserver.cc:460] Webserver started at http://127.20.81.1:45803/ using document root <none> and password file <none>
I20260808 14:36:08.417577 28973 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:08.417646 28973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:08.417796 28973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:08.418881 28973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "dbf8bfedd66048d192199782108b96e6"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "54adc4a974fc0c27c59d37d5cfa1d571"
server_key_iv: "baddce59f85dee36da9e0acac5b7ff5f"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.419265 28973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "dbf8bfedd66048d192199782108b96e6"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "54adc4a974fc0c27c59d37d5cfa1d571"
server_key_iv: "baddce59f85dee36da9e0acac5b7ff5f"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.420694 28973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:36:08.421455 28990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:08.421622 28973 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:08.421720 28973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "dbf8bfedd66048d192199782108b96e6"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "54adc4a974fc0c27c59d37d5cfa1d571"
server_key_iv: "baddce59f85dee36da9e0acac5b7ff5f"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.421800 28973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:08.456425 28973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:08.458504 28973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:08.458669 28973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:08.459209 28973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:08.459265 28973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:08.459306 28973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:08.459353 28973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:08.466761 28973 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:36507
I20260808 14:36:08.466852 29114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:36507 every 8 connection(s)
I20260808 14:36:08.467188 28973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:08.468063 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 28973
I20260808 14:36:08.468190 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:36:08.468406 20804 external_mini_cluster.cc:1428] Setting key 7e87ee835ed6260defb71dffe58bff5b
I20260808 14:36:08.470057 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.459851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:38555 (local address 127.20.81.62:46041)
0808 14:36:08.459926 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.459928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.460165 (+ 237us) server_negotiation.cc:407] Connection header received
0808 14:36:08.460833 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.460835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.460850 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.460916 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:08.461602 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.462181 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.463401 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.463633 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.463728 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.466774 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:08.466776 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:08.466777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:08.466787 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:08.468577 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.468985 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.468987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.468987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.469048 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.469397 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.469398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.469398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.469510 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:08.469565 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.469922 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.469990 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:36:08.470407 29000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.459845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46041 (local address 127.20.81.1:38555)
0808 14:36:08.460036 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:08.460077 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:08.460714 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:08.461000 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:08.461006 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:08.461287 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:08.461494 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.461500 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.462288 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.462289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.463291 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.463295 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.463741 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.463742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.463873 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.464474 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:08.464486 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:08.466669 (+ 2183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:08.468668 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.468676 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.468678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.468903 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.469142 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.469143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.469144 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.469314 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.469579 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:08.469587 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:08.469766 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 14:36:08.469892 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 14:36:08.470095 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":107,"threads_started":1}
I20260808 14:36:08.471349 29115 heartbeater.cc:347] Connected to a master server at 127.20.81.62:46041
I20260808 14:36:08.471447 29115 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:08.471635 29115 heartbeater.cc:511] Master 127.20.81.62:46041 requested a full tablet report, sending...
I20260808 14:36:08.472675 28895 ts_manager.cc:194] Registered new tserver with Master: dbf8bfedd66048d192199782108b96e6 (127.20.81.1:36507)
I20260808 14:36:08.473549 28895 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:38555
I20260808 14:36:08.478159 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.472526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:36423 (local address 127.20.81.62:46041)
0808 14:36:08.472591 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.472593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.472718 (+ 125us) server_negotiation.cc:407] Connection header received
0808 14:36:08.472793 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.472794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.472804 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.472856 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:08.473224 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.473723 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.474442 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.474648 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.474728 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.475690 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:08.475691 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:08.475692 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:08.475698 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:08.477078 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.477409 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.477410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.477411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.477463 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.477666 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.477666 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.477667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.477769 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:08.477838 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.477987 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.478058 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:36:08.478159 29122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.472478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46041 (local address 127.20.81.1:36423)
0808 14:36:08.472640 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:08.472653 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:08.472726 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:08.472875 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:08.472876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:08.473092 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:08.473154 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.473156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.473812 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.473813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.474340 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.474342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.474730 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.474731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.474801 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.475266 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:08.475270 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:08.475587 (+ 317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:08.477176 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.477177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.477178 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.477342 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.477536 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.477537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.477537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.477596 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.477832 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:08.477833 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:08.477876 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:36:08.477961 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 14:36:08.478060 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":94,"threads_started":1}
WARNING: no policy specified for oryx/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab.
Entry for principal oryx/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab.
I20260808 14:36:08.499065 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46041
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab
--principal=oryx/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:08.580081 29125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:08.580271 29125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:08.580293 29125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:08.581384 29125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:08.581421 29125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:08.581440 29125 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:36:08.581458 29125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:36:08.582861 29125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab
--principal=oryx/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.81.62:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:08.583031 29125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:08.583200 29125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:08.588052 29131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:08.588032 29134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:08.588066 29125 server_base.cc:1034] running on GCE node
W20260808 14:36:08.588049 29132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:08.588471 29125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:08.588721 29125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:08.589879 29125 hybrid_clock.cc:648] HybridClock initialized: now 1786199768589870 us; error 37 us; skew 500 ppm
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:08.592252 29125 init.cc:377] Logged in from keytab as oryx/127.20.81.2@KRBTEST.COM (short username oryx)
I20260808 14:36:08.592741 29125 webserver.cc:460] Webserver started at http://127.20.81.2:38105/ using document root <none> and password file <none>
I20260808 14:36:08.592919 29125 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:08.592957 29125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:08.593044 29125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:08.594020 29125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "8f9081b0f32e4956b4ccc7442c28689b"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "88567ad5cb0964f2da520cfc6e1df418"
server_key_iv: "22d713ffa82403a67433dd7c5c4ba082"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.594316 29125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "8f9081b0f32e4956b4ccc7442c28689b"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "88567ad5cb0964f2da520cfc6e1df418"
server_key_iv: "22d713ffa82403a67433dd7c5c4ba082"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.595530 29125 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:36:08.596220 29141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:08.596369 29125 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:08.596457 29125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "8f9081b0f32e4956b4ccc7442c28689b"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "88567ad5cb0964f2da520cfc6e1df418"
server_key_iv: "22d713ffa82403a67433dd7c5c4ba082"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.596514 29125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:08.605749 29125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:08.607940 29125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:08.608094 29125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:08.608645 29125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:08.608704 29125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:08.608747 29125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:08.608779 29125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:08.615887 29125 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:37005
I20260808 14:36:08.615947 29262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:37005 every 8 connection(s)
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:08.616261 29125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:08.619339 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.609324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:48675 (local address 127.20.81.62:46041)
0808 14:36:08.609387 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.609390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.609568 (+ 178us) server_negotiation.cc:407] Connection header received
0808 14:36:08.610151 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.610153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.610167 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.610244 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:08.611176 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.612008 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.613728 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.614003 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.614063 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.616784 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:08.616786 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:08.616787 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:08.616794 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:08.617987 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.618377 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.618378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.618378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.618437 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.618689 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.618690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.618691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.618809 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:08.618884 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.619158 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.619249 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:36:08.619520 29150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.609277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46041 (local address 127.20.81.2:48675)
0808 14:36:08.609453 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:08.609489 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:08.610032 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:08.610357 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:08.610362 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:08.610773 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:08.611072 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.611078 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.612110 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.612112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.613633 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.613637 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.614072 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.614074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.614239 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.614808 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:08.614821 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:08.616676 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:08.618067 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.618075 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.618077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.618300 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.618505 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.618505 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.618506 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.618621 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.618875 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:08.618882 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:08.619019 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 14:36:08.619125 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:36:08.619291 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":75,"threads_started":1}
I20260808 14:36:08.620005 29263 heartbeater.cc:347] Connected to a master server at 127.20.81.62:46041
I20260808 14:36:08.620100 29263 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:08.620294 29263 heartbeater.cc:511] Master 127.20.81.62:46041 requested a full tablet report, sending...
I20260808 14:36:08.620726 28895 ts_manager.cc:194] Registered new tserver with Master: 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005)
I20260808 14:36:08.621256 28895 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:48675
I20260808 14:36:08.624197 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 29125
I20260808 14:36:08.624353 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:08.624655 20804 external_mini_cluster.cc:1428] Setting key a27c50ffe1234ed8f07826d64437de32
I20260808 14:36:08.626725 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.621135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:32953 (local address 127.20.81.62:46041)
0808 14:36:08.621176 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.621178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.621236 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:36:08.621350 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.621350 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.621359 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.621426 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:08.621787 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.622351 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.623023 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.623197 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.623245 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.624017 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:08.624019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:08.624019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:08.624025 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:08.625642 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.626024 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.626025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.626025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.626074 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.626266 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.626267 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.626267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.626394 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:08.626446 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.626603 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.626667 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:36:08.626847 29272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.621060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46041 (local address 127.20.81.2:32953)
0808 14:36:08.621183 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:08.621194 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:08.621252 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:08.621435 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:08.621436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:08.621650 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:08.621710 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.621712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.622456 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.622457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.622952 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.622954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.623255 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.623256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.623305 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.623665 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:08.623669 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:08.623937 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:08.625715 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.625717 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.625717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.625941 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.626135 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.626136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.626137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.626207 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.626454 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:08.626455 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:08.626505 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 14:36:08.626577 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:36:08.626692 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":66,"threads_started":1}
WARNING: no policy specified for oryx/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab.
Entry for principal oryx/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab.
I20260808 14:36:08.651352 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46041
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab
--principal=oryx/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:08.733001 29275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:08.733229 29275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:08.733268 29275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:08.734407 29275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:08.734467 29275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:08.734503 29275 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:36:08.734539 29275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:36:08.736055 29275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab
--principal=oryx/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.81.62:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:08.736327 29275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:08.736572 29275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:08.741480 29282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:08.741470 29285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:08.741564 29281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:08.741643 29275 server_base.cc:1034] running on GCE node
I20260808 14:36:08.741891 29275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:08.742174 29275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:08.743348 29275 hybrid_clock.cc:648] HybridClock initialized: now 1786199768743325 us; error 32 us; skew 500 ppm
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:08.745934 29275 init.cc:377] Logged in from keytab as oryx/127.20.81.3@KRBTEST.COM (short username oryx)
I20260808 14:36:08.746372 29275 webserver.cc:460] Webserver started at http://127.20.81.3:43841/ using document root <none> and password file <none>
I20260808 14:36:08.746620 29275 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:08.746686 29275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:08.746835 29275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:08.747872 29275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "80d65f7c59704cf7942eab366ffe6efa"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "be0d02e8050a4e9f421e3c53b794b2b7"
server_key_iv: "47c8f3e124f2fbb34aa17959313171a7"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.748240 29275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "80d65f7c59704cf7942eab366ffe6efa"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "be0d02e8050a4e9f421e3c53b794b2b7"
server_key_iv: "47c8f3e124f2fbb34aa17959313171a7"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.749747 29275 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:36:08.750437 29292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:08.750604 29275 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:08.750701 29275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "80d65f7c59704cf7942eab366ffe6efa"
format_stamp: "Formatted at 2026-08-08 14:36:08 on dist-test-slave-8n49"
server_key: "be0d02e8050a4e9f421e3c53b794b2b7"
server_key_iv: "47c8f3e124f2fbb34aa17959313171a7"
server_key_version: "encryptionkey@0"
I20260808 14:36:08.750778 29275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:08.762846 29275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:08.764685 29275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:08.764835 29275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:08.765331 29275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:08.765393 29275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:08.765437 29275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:08.765477 29275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:08.772433 29275 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:40573
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:08.772502 29415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:40573 every 8 connection(s)
I20260808 14:36:08.772819 29275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:08.775610 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.765827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:49403 (local address 127.20.81.62:46041)
0808 14:36:08.765894 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.765898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.766070 (+ 172us) server_negotiation.cc:407] Connection header received
0808 14:36:08.766563 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.766565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.766579 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.766669 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:08.767439 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.768301 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.769939 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.770289 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.770373 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.773048 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:08.773050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:08.773051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:08.773061 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:08.774488 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.774846 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.774846 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.774847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.774928 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.775143 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.775144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.775144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.775248 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:08.775299 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.775489 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.775546 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:36:08.775867 29302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.765791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46041 (local address 127.20.81.3:49403)
0808 14:36:08.765937 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:08.765976 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:08.766468 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:08.766717 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:08.766721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:08.767046 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:08.767330 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.767337 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.768405 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.768406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.769823 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.769826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.770394 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.770395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.770536 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.771102 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:08.771112 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:08.772956 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:08.774559 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.774563 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.774565 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.774777 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.774989 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.774990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.774990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.775085 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.775288 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:08.775291 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:08.775394 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 14:36:08.775474 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:36:08.775606 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":78,"threads_started":1}
I20260808 14:36:08.776364 29416 heartbeater.cc:347] Connected to a master server at 127.20.81.62:46041
I20260808 14:36:08.776458 29416 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:08.776415 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 29275
I20260808 14:36:08.776576 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:08.776678 29416 heartbeater.cc:511] Master 127.20.81.62:46041 requested a full tablet report, sending...
I20260808 14:36:08.776801 20804 external_mini_cluster.cc:1428] Setting key 942728c22f2064b5683416799dbe989d
I20260808 14:36:08.777508 28895 ts_manager.cc:194] Registered new tserver with Master: 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573)
I20260808 14:36:08.777897 28895 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:49403
I20260808 14:36:08.782733 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.777503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:43867 (local address 127.20.81.62:46041)
0808 14:36:08.778030 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.778032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.778039 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:08.778068 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.778068 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.778079 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.778155 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:08.778509 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.778945 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.779565 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.779738 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.779785 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.780536 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:08.780537 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:08.780538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:08.780543 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:08.781869 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.782161 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.782162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.782162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.782209 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.782363 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.782364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.782364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.782452 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:08.782501 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.782623 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.782676 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507}
I20260808 14:36:08.782752 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.777507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46041 (local address 127.20.81.3:43867)
0808 14:36:08.777675 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:08.777685 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:08.777724 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:08.778161 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:08.778162 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:08.778362 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:08.778431 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.778434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.779028 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.779029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.779499 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.779500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.779799 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.779800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.779847 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.780206 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:08.780210 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:08.780464 (+ 254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:08.781937 (+ 1473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.781937 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.781938 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.782099 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.782263 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:08.782263 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:08.782264 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:08.782314 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:08.782517 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:08.782518 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:08.782553 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:36:08.782607 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:36:08.782682 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":117,"threads_started":1}
I20260808 14:36:08.788406 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:36:08.810206 28949 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:08.804992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48560 (local address 127.20.81.62:46041)
0808 14:36:08.805039 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.805041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.805054 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:36:08.805139 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.805140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.805149 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.805190 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:08.805744 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.806232 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.806934 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.807115 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.807163 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.810107 (+ 2944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48560: BlockingRecv error: recv got EOF from 127.0.0.1:48560 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 14:36:08 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:08.817227 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.810888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48570 (local address 127.20.81.62:46041)
0808 14:36:08.810943 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.810945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.811064 (+ 119us) server_negotiation.cc:407] Connection header received
0808 14:36:08.811144 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.811145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.811153 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.811200 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:08.811749 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.812230 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.812913 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.813083 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.813135 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.815093 (+ 1958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:08.815094 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:08.815095 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:08.815101 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:08.816331 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.816674 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.816676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.816676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.816728 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:08.816878 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:08.816878 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:08.816879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:08.816967 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:08.817037 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.817112 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.817167 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:36:08.818656 28895 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:08.820394 28895 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:08.826785 29440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.822756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:40573 (local address 127.0.0.1:35978)
0808 14:36:08.823129 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:08.823139 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:08.823191 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:08.823399 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:08.823402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:08.823404 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:08.823469 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.823471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.824462 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.824464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.825666 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.825669 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.826456 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.826457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.826546 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.826561 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:36:08.826640 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:36:08.826688 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":56,"thread_start_us":104,"threads_started":1}
I20260808 14:36:08.826787 29443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.823008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35978 (local address 127.20.81.3:40573)
0808 14:36:08.823201 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.823206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.823216 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:08.823259 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.823262 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.823280 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.823390 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:08.823550 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.824383 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.825758 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.826369 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.826449 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.826525 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.826656 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.826696 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":87,"threads_started":1}
I20260808 14:36:08.827256 29441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.822761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:37005 (local address 127.0.0.1:60876)
0808 14:36:08.823252 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:08.823262 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:08.823317 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:08.823492 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:08.823493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:08.823495 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:08.823715 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.823718 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.824789 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.824791 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.826104 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.826106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.827036 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.827036 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.827093 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.827096 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:36:08.827153 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:36:08.827191 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":109,"threads_started":1}
I20260808 14:36:08.827297 29442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.822875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60876 (local address 127.20.81.2:37005)
0808 14:36:08.823075 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.823080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.823333 (+ 253us) server_negotiation.cc:407] Connection header received
0808 14:36:08.823382 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.823384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.823401 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.823499 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:08.823794 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.824695 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.826191 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.826955 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.827029 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.827101 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.827166 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.827204 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":83,"threads_started":1}
I20260808 14:36:08.827495 29344 tablet_service.cc:1467] Processing CreateTablet for tablet 824fd4bad9974681bdad569e2348d422 (DEFAULT_TABLE table=test-table [id=9f0dae8ed66340a99b6f92d5b2fc93c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:08.827847 29344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 824fd4bad9974681bdad569e2348d422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:08.828266 29439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.822757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:36507 (local address 127.0.0.1:43208)
0808 14:36:08.823016 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:08.823061 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:08.823139 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:08.823657 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:08.823658 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:08.823661 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:08.823713 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.823715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.825795 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.825796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.826717 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:08.826720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.828022 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.828023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:08.828086 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.828090 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:08.828141 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:36:08.828176 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":45,"threads_started":1}
I20260808 14:36:08.828281 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:08.823020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43208 (local address 127.20.81.1:36507)
0808 14:36:08.823313 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:08.823317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:08.823328 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:36:08.823561 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:08.823564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:08.823577 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:08.823649 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:08.824626 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.825707 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.826805 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:08.827907 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:08.827992 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:08.828043 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:08.828171 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 14:36:08.828201 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":83,"threads_started":1}
I20260808 14:36:08.829324 29192 tablet_service.cc:1467] Processing CreateTablet for tablet 824fd4bad9974681bdad569e2348d422 (DEFAULT_TABLE table=test-table [id=9f0dae8ed66340a99b6f92d5b2fc93c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:08.829689 29192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 824fd4bad9974681bdad569e2348d422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:08.831693 29445 tablet_bootstrap.cc:492] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: Bootstrap starting.
I20260808 14:36:08.832103 29045 tablet_service.cc:1467] Processing CreateTablet for tablet 824fd4bad9974681bdad569e2348d422 (DEFAULT_TABLE table=test-table [id=9f0dae8ed66340a99b6f92d5b2fc93c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:08.832259 29445 tablet_bootstrap.cc:654] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:08.832530 29045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 824fd4bad9974681bdad569e2348d422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:08.832653 29445 log.cc:824] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:08.833330 29445 tablet_bootstrap.cc:492] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: No bootstrap required, opened a new log
I20260808 14:36:08.833410 29445 ts_tablet_manager.cc:1397] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:36:08.833716 29447 tablet_bootstrap.cc:492] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: Bootstrap starting.
I20260808 14:36:08.834354 29447 tablet_bootstrap.cc:654] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:08.834690 29447 log.cc:824] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:08.835666 29447 tablet_bootstrap.cc:492] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: No bootstrap required, opened a new log
I20260808 14:36:08.835748 29447 ts_tablet_manager.cc:1397] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:36:08.835635 29445 raft_consensus.cc:348] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } }
I20260808 14:36:08.835793 29445 raft_consensus.cc:374] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:08.835834 29445 raft_consensus.cc:729] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d65f7c59704cf7942eab366ffe6efa, State: Initialized, Role: FOLLOWER
I20260808 14:36:08.835953 29445 consensus_queue.cc:260] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } }
I20260808 14:36:08.836246 29416 heartbeater.cc:503] Master 127.20.81.62:46041 was elected leader, sending a full tablet report...
I20260808 14:36:08.836511 29445 ts_tablet_manager.cc:1428] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:36:08.836740 29449 tablet_bootstrap.cc:492] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: Bootstrap starting.
I20260808 14:36:08.837363 29449 tablet_bootstrap.cc:654] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:08.837652 29449 log.cc:824] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:08.837718 29447 raft_consensus.cc:348] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } }
I20260808 14:36:08.837893 29447 raft_consensus.cc:374] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:08.837939 29447 raft_consensus.cc:729] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9081b0f32e4956b4ccc7442c28689b, State: Initialized, Role: FOLLOWER
I20260808 14:36:08.838080 29447 consensus_queue.cc:260] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } }
I20260808 14:36:08.838363 29447 ts_tablet_manager.cc:1428] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:36:08.838389 29263 heartbeater.cc:503] Master 127.20.81.62:46041 was elected leader, sending a full tablet report...
I20260808 14:36:08.838405 29449 tablet_bootstrap.cc:492] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: No bootstrap required, opened a new log
I20260808 14:36:08.838464 29449 ts_tablet_manager.cc:1397] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:36:08.840092 29449 raft_consensus.cc:348] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } }
I20260808 14:36:08.840210 29449 raft_consensus.cc:374] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:08.840231 29449 raft_consensus.cc:729] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf8bfedd66048d192199782108b96e6, State: Initialized, Role: FOLLOWER
I20260808 14:36:08.840360 29449 consensus_queue.cc:260] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } }
I20260808 14:36:08.840647 29449 ts_tablet_manager.cc:1428] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:36:08.840716 29115 heartbeater.cc:503] Master 127.20.81.62:46041 was elected leader, sending a full tablet report...
W20260808 14:36:08.866895 29264 tablet.cc:2369] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:36:08.967973 29116 tablet.cc:2369] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:36:09.023542 29417 tablet.cc:2369] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:36:09.074244 29452 raft_consensus.cc:482] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:09.074380 29452 raft_consensus.cc:504] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } }
I20260808 14:36:09.074781 29452 leader_election.cc:288] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573), dbf8bfedd66048d192199782108b96e6 (127.20.81.1:36507)
I20260808 14:36:09.078648 29443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.075092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:58201 (local address 127.20.81.3:40573)
0808 14:36:09.075154 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.075157 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.075166 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:09.075203 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.075204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.075223 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.075274 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:09.075476 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.076236 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.077714 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.078262 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.078339 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.078349 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.078537 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.078574 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:36:09.078649 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.075103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:34923 (local address 127.20.81.1:36507)
0808 14:36:09.075150 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.075151 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.075314 (+ 163us) server_negotiation.cc:407] Connection header received
0808 14:36:09.075348 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.075349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.075364 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.075408 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:09.075571 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.076274 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.077714 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.078262 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.078339 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.078350 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.078537 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.078575 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:36:09.078672 29150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.075022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:40573 (local address 127.20.81.2:58201)
0808 14:36:09.075066 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.075081 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:09.075137 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:09.075299 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:09.075300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:09.075301 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:09.075382 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.075384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.076328 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.076329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.077621 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.077624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.078352 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.078353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.078441 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.078446 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:36:09.078509 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 14:36:09.078556 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19,"mutex_wait_us":14}
I20260808 14:36:09.078685 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.075024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:36507 (local address 127.20.81.2:34923)
0808 14:36:09.075220 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.075235 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:09.075301 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:09.075426 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:09.075427 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:09.075429 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:09.075501 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.075502 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.076343 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.076344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.077621 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.077624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.078352 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.078353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.078463 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.078467 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:09.078521 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:36:09.078556 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":79,"thread_start_us":121,"threads_started":1}
I20260808 14:36:09.079113 29066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "824fd4bad9974681bdad569e2348d422" candidate_uuid: "8f9081b0f32e4956b4ccc7442c28689b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbf8bfedd66048d192199782108b96e6" is_pre_election: true
I20260808 14:36:09.079197 29367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "824fd4bad9974681bdad569e2348d422" candidate_uuid: "8f9081b0f32e4956b4ccc7442c28689b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d65f7c59704cf7942eab366ffe6efa" is_pre_election: true
I20260808 14:36:09.079289 29066 raft_consensus.cc:2454] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9081b0f32e4956b4ccc7442c28689b in term 0.
I20260808 14:36:09.079315 29367 raft_consensus.cc:2454] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9081b0f32e4956b4ccc7442c28689b in term 0.
I20260808 14:36:09.079530 29145 leader_election.cc:302] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9081b0f32e4956b4ccc7442c28689b, dbf8bfedd66048d192199782108b96e6; no voters:
I20260808 14:36:09.079660 29452 raft_consensus.cc:2781] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:09.079713 29452 raft_consensus.cc:482] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:09.079736 29452 raft_consensus.cc:3037] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.080720 29452 raft_consensus.cc:504] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } }
I20260808 14:36:09.080865 29452 leader_election.cc:288] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [CANDIDATE]: Term 1 election: Requested vote from peers 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573), dbf8bfedd66048d192199782108b96e6 (127.20.81.1:36507)
I20260808 14:36:09.081018 29367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "824fd4bad9974681bdad569e2348d422" candidate_uuid: "8f9081b0f32e4956b4ccc7442c28689b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d65f7c59704cf7942eab366ffe6efa"
I20260808 14:36:09.081028 29066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "824fd4bad9974681bdad569e2348d422" candidate_uuid: "8f9081b0f32e4956b4ccc7442c28689b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbf8bfedd66048d192199782108b96e6"
I20260808 14:36:09.081115 29367 raft_consensus.cc:3037] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.081107 29066 raft_consensus.cc:3037] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.081964 29367 raft_consensus.cc:2454] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9081b0f32e4956b4ccc7442c28689b in term 1.
I20260808 14:36:09.081964 29066 raft_consensus.cc:2454] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9081b0f32e4956b4ccc7442c28689b in term 1.
I20260808 14:36:09.082149 29145 leader_election.cc:302] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9081b0f32e4956b4ccc7442c28689b, dbf8bfedd66048d192199782108b96e6; no voters:
I20260808 14:36:09.082237 29452 raft_consensus.cc:2781] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:09.082392 29452 raft_consensus.cc:686] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 LEADER]: Becoming Leader. State: Replica: 8f9081b0f32e4956b4ccc7442c28689b, State: Running, Role: LEADER
I20260808 14:36:09.082490 29452 consensus_queue.cc:237] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } }
I20260808 14:36:09.083462 28896 catalog_manager.cc:5495] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2). New cstate: current_term: 1 leader_uuid: "8f9081b0f32e4956b4ccc7442c28689b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:09.109612 29442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.107194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60878 (local address 127.20.81.2:37005)
0808 14:36:09.107257 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.107259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.107268 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:09.107311 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.107312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.107331 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.107407 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:09.107551 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.108024 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.108825 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.109011 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.109082 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.109270 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:09.109366 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:09.109446 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.109499 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.109518 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:36:09.111408 29367 raft_consensus.cc:1261] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Refusing update from remote peer 8f9081b0f32e4956b4ccc7442c28689b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.111440 29066 raft_consensus.cc:1261] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Refusing update from remote peer 8f9081b0f32e4956b4ccc7442c28689b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.111780 29452 consensus_queue.cc:1035] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.111912 29455 consensus_queue.cc:1035] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.114292 29458 mvcc.cc:205] Tried to move back new op lower bound from 7316274254277693440 to 7316274254162436096. Current Snapshot: MvccSnapshot[applied={T|T < 7316274254277693440}]
I20260808 14:36:09.114725 29460 mvcc.cc:205] Tried to move back new op lower bound from 7316274254277693440 to 7316274254162436096. Current Snapshot: MvccSnapshot[applied={T|T < 7316274254277693440 or (T in {7316274254277693440})}]
I20260808 14:36:09.115219 29459 mvcc.cc:205] Tried to move back new op lower bound from 7316274254277693440 to 7316274254162436096. Current Snapshot: MvccSnapshot[applied={T|T < 7316274254277693440 or (T in {7316274254277693440})}]
I20260808 14:36:09.116917 28896 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:09.116997 28896 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:09.117695 28896 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: Sending DeleteTablet for 3 replicas of tablet 824fd4bad9974681bdad569e2348d422
I20260808 14:36:09.117981 29344 tablet_service.cc:1514] Processing DeleteTablet for tablet 824fd4bad9974681bdad569e2348d422 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:35978
I20260808 14:36:09.118053 29192 tablet_service.cc:1514] Processing DeleteTablet for tablet 824fd4bad9974681bdad569e2348d422 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:60876
I20260808 14:36:09.118067 29045 tablet_service.cc:1514] Processing DeleteTablet for tablet 824fd4bad9974681bdad569e2348d422 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:43208
I20260808 14:36:09.118273 29471 tablet_replica.cc:330] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: stopping tablet replica
I20260808 14:36:09.118403 29471 raft_consensus.cc:2229] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:09.118501 28896 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 14:36:09.118618 29469 tablet_replica.cc:330] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: stopping tablet replica
W20260808 14:36:09.118639 28896 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:09.118707 29469 raft_consensus.cc:2229] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:09.118820 29469 raft_consensus.cc:2258] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.118575 29471 raft_consensus.cc:2258] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.119261 29469 ts_tablet_manager.cc:1905] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.119796 29471 ts_tablet_manager.cc:1905] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.120121 29344 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8802fe51bb4d3cbee821ec9d73a972 (DEFAULT_TABLE table=test-table [id=64dbc7b9d1924e2983ace51a724692e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:09.120370 29344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8802fe51bb4d3cbee821ec9d73a972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.121321 29469 ts_tablet_manager.cc:1918] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:09.121403 29469 log.cc:1196] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/824fd4bad9974681bdad569e2348d422
I20260808 14:36:09.121681 29469 ts_tablet_manager.cc:1939] T 824fd4bad9974681bdad569e2348d422 P 80d65f7c59704cf7942eab366ffe6efa: Deleting consensus metadata
I20260808 14:36:09.121718 29445 tablet_bootstrap.cc:492] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: Bootstrap starting.
I20260808 14:36:09.121963 29471 ts_tablet_manager.cc:1918] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:09.122040 29471 log.cc:1196] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/824fd4bad9974681bdad569e2348d422
I20260808 14:36:09.122146 29445 tablet_bootstrap.cc:654] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.122311 29471 ts_tablet_manager.cc:1939] T 824fd4bad9974681bdad569e2348d422 P 8f9081b0f32e4956b4ccc7442c28689b: Deleting consensus metadata
I20260808 14:36:09.122604 28877 catalog_manager.cc:4841] TS 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573): tablet 824fd4bad9974681bdad569e2348d422 (table test-table [id=9f0dae8ed66340a99b6f92d5b2fc93c7]) successfully deleted
I20260808 14:36:09.122751 29445 tablet_bootstrap.cc:492] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: No bootstrap required, opened a new log
I20260808 14:36:09.122768 28878 catalog_manager.cc:4841] TS 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005): tablet 824fd4bad9974681bdad569e2348d422 (table test-table [id=9f0dae8ed66340a99b6f92d5b2fc93c7]) successfully deleted
I20260808 14:36:09.122794 29445 ts_tablet_manager.cc:1397] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:36:09.122929 29445 raft_consensus.cc:348] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.122992 29445 raft_consensus.cc:374] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.123029 29445 raft_consensus.cc:729] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d65f7c59704cf7942eab366ffe6efa, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.123037 29192 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8802fe51bb4d3cbee821ec9d73a972 (DEFAULT_TABLE table=test-table [id=64dbc7b9d1924e2983ace51a724692e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:09.123037 29045 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8802fe51bb4d3cbee821ec9d73a972 (DEFAULT_TABLE table=test-table [id=64dbc7b9d1924e2983ace51a724692e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:09.123076 29445 consensus_queue.cc:260] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.123140 29192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8802fe51bb4d3cbee821ec9d73a972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.123140 29045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8802fe51bb4d3cbee821ec9d73a972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.123158 29445 ts_tablet_manager.cc:1428] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:09.124341 29447 tablet_bootstrap.cc:492] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: Bootstrap starting.
I20260808 14:36:09.124434 29449 tablet_bootstrap.cc:492] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: Bootstrap starting.
I20260808 14:36:09.124801 29447 tablet_bootstrap.cc:654] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.124850 29449 tablet_bootstrap.cc:654] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.125510 29447 tablet_bootstrap.cc:492] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: No bootstrap required, opened a new log
I20260808 14:36:09.125577 29447 ts_tablet_manager.cc:1397] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:36:09.125761 29449 tablet_bootstrap.cc:492] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: No bootstrap required, opened a new log
I20260808 14:36:09.125744 29447 raft_consensus.cc:348] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.125808 29447 raft_consensus.cc:374] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.125801 29449 ts_tablet_manager.cc:1397] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:09.125828 29447 raft_consensus.cc:729] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9081b0f32e4956b4ccc7442c28689b, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.125873 29447 consensus_queue.cc:260] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.125955 29447 ts_tablet_manager.cc:1428] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:09.125942 29449 raft_consensus.cc:348] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.126006 29449 raft_consensus.cc:374] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.126031 29449 raft_consensus.cc:729] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf8bfedd66048d192199782108b96e6, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.126075 29449 consensus_queue.cc:260] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.126187 29449 ts_tablet_manager.cc:1428] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:09.132510 29470 tablet_replica.cc:330] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: stopping tablet replica
I20260808 14:36:09.132666 29470 raft_consensus.cc:2229] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:09.132776 29470 raft_consensus.cc:2258] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.133229 29470 ts_tablet_manager.cc:1905] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.135032 29470 ts_tablet_manager.cc:1918] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:09.135115 29470 log.cc:1196] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/824fd4bad9974681bdad569e2348d422
I20260808 14:36:09.135377 29470 ts_tablet_manager.cc:1939] T 824fd4bad9974681bdad569e2348d422 P dbf8bfedd66048d192199782108b96e6: Deleting consensus metadata
I20260808 14:36:09.135917 28882 catalog_manager.cc:4841] TS dbf8bfedd66048d192199782108b96e6 (127.20.81.1:36507): tablet 824fd4bad9974681bdad569e2348d422 (table test-table [id=9f0dae8ed66340a99b6f92d5b2fc93c7]) successfully deleted
I20260808 14:36:09.168491 29453 raft_consensus.cc:482] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:09.171203 29453 raft_consensus.cc:504] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.171726 29453 leader_election.cc:288] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005), 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573)
I20260808 14:36:09.176451 29442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.172053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:58283 (local address 127.20.81.2:37005)
0808 14:36:09.172102 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.172105 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.172115 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:09.172182 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.172183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.172198 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.172258 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:09.172805 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.173627 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.175363 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.176002 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.176052 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.176064 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.176328 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.176380 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:36:09.176478 29475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.171891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:37005 (local address 127.20.81.1:58283)
0808 14:36:09.172031 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.172045 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:09.172113 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:09.172639 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:09.172640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:09.172642 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:09.172705 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.172707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.173741 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.173742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.175245 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.175250 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.176142 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.176143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.176217 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.176221 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:09.176298 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:36:09.176340 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":2,"thread_start_us":72,"threads_started":1}
I20260808 14:36:09.176867 29214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8802fe51bb4d3cbee821ec9d73a972" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9081b0f32e4956b4ccc7442c28689b" is_pre_election: true
I20260808 14:36:09.177003 29214 raft_consensus.cc:2454] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 0.
I20260808 14:36:09.177207 28992 leader_election.cc:302] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9081b0f32e4956b4ccc7442c28689b, dbf8bfedd66048d192199782108b96e6; no voters:
I20260808 14:36:09.177341 29453 raft_consensus.cc:2781] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:09.177376 29453 raft_consensus.cc:482] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:09.177407 29453 raft_consensus.cc:3037] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.177932 29443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.172408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:50163 (local address 127.20.81.3:40573)
0808 14:36:09.172456 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.172458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.172466 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:36:09.172496 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.172497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.172508 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.172594 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:09.172788 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.173618 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.176914 (+ 3296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.177544 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.177588 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.177596 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.177827 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.177870 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:36:09.178017 29476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.172172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:40573 (local address 127.20.81.1:50163)
0808 14:36:09.172280 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.172292 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:09.172340 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:09.172593 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:09.172595 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:09.172597 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:09.172687 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.172690 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.173741 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.173742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.176405 (+ 2663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.176407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.177688 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.177689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.177746 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.177749 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:36:09.177821 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:36:09.177868 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":1225,"thread_start_us":56,"threads_started":1}
I20260808 14:36:09.178303 29453 raft_consensus.cc:504] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.178439 29453 leader_election.cc:288] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005), 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573)
I20260808 14:36:09.178761 29367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8802fe51bb4d3cbee821ec9d73a972" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d65f7c59704cf7942eab366ffe6efa" is_pre_election: true
I20260808 14:36:09.178860 29367 raft_consensus.cc:2454] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 0.
I20260808 14:36:09.178777 29366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8802fe51bb4d3cbee821ec9d73a972" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d65f7c59704cf7942eab366ffe6efa"
I20260808 14:36:09.178906 29366 raft_consensus.cc:3037] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.178948 29214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8802fe51bb4d3cbee821ec9d73a972" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9081b0f32e4956b4ccc7442c28689b"
I20260808 14:36:09.179021 29214 raft_consensus.cc:3037] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.179783 29214 raft_consensus.cc:2454] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 1.
I20260808 14:36:09.179945 29366 raft_consensus.cc:2454] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 1.
I20260808 14:36:09.180049 28992 leader_election.cc:302] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9081b0f32e4956b4ccc7442c28689b, dbf8bfedd66048d192199782108b96e6; no voters:
I20260808 14:36:09.180801 29453 raft_consensus.cc:2781] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:09.180958 29453 raft_consensus.cc:686] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 1 LEADER]: Becoming Leader. State: Replica: dbf8bfedd66048d192199782108b96e6, State: Running, Role: LEADER
I20260808 14:36:09.181041 29453 consensus_queue.cc:237] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.184628 28896 catalog_manager.cc:5495] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbf8bfedd66048d192199782108b96e6 (127.20.81.1). New cstate: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:36:09 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199768, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.62@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:09.226157 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.217516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48574 (local address 127.20.81.62:46041)
0808 14:36:09.217566 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.217568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.217760 (+ 192us) server_negotiation.cc:407] Connection header received
0808 14:36:09.217831 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.217832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.217845 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.217912 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:09.218631 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.219476 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.220624 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.220851 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.220950 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.223346 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:09.223348 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:09.223348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:09.223355 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:09.224919 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:09.225368 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:09.225369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:09.225370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:09.225429 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:09.225664 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:09.225664 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:09.225665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:09.225771 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:09.225826 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.226009 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.226089 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:36:09.226281 29484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.217472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46041 (local address 127.0.0.1:48574)
0808 14:36:09.217671 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.217683 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:09.217759 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:09.217983 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:09.217984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:09.218460 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:09.218529 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.218533 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.219560 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.219562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.220504 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.220508 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.220971 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.220973 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.221043 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.221565 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:09.221570 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:09.223253 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:09.224997 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:09.225006 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:09.225014 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:09.225281 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:09.225517 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:09.225519 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:09.225519 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:09.225596 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:09.225835 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:09.225845 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:09.225902 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 14:36:09.225982 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:36:09.226167 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":56,"thread_start_us":131,"threads_started":1}
I20260808 14:36:09.228358 28896 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:48574:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:36:09.228614 28896 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:09.230057 29192 tablet_service.cc:1467] Processing CreateTablet for tablet 973cc334f49c45458358adcafb0d1253 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3054dd54bc894745831d470b676b89fc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:36:09.230095 29045 tablet_service.cc:1467] Processing CreateTablet for tablet 973cc334f49c45458358adcafb0d1253 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3054dd54bc894745831d470b676b89fc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:36:09.230260 29192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973cc334f49c45458358adcafb0d1253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.230261 29045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973cc334f49c45458358adcafb0d1253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.231813 29447 tablet_bootstrap.cc:492] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: Bootstrap starting.
I20260808 14:36:09.231916 29344 tablet_service.cc:1467] Processing CreateTablet for tablet 973cc334f49c45458358adcafb0d1253 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3054dd54bc894745831d470b676b89fc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:36:09.232090 29344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973cc334f49c45458358adcafb0d1253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.232523 29447 tablet_bootstrap.cc:654] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.232761 29449 tablet_bootstrap.cc:492] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: Bootstrap starting.
I20260808 14:36:09.233171 29449 tablet_bootstrap.cc:654] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.233619 29445 tablet_bootstrap.cc:492] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: Bootstrap starting.
I20260808 14:36:09.234066 29445 tablet_bootstrap.cc:654] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.234227 29447 tablet_bootstrap.cc:492] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: No bootstrap required, opened a new log
I20260808 14:36:09.234297 29447 ts_tablet_manager.cc:1397] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 14:36:09.234467 29447 raft_consensus.cc:348] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.234566 29447 raft_consensus.cc:374] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.234613 29447 raft_consensus.cc:729] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9081b0f32e4956b4ccc7442c28689b, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.234659 29447 consensus_queue.cc:260] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.234766 29447 ts_tablet_manager.cc:1428] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:09.234833 29445 tablet_bootstrap.cc:492] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: No bootstrap required, opened a new log
I20260808 14:36:09.234890 29445 ts_tablet_manager.cc:1397] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:36:09.234871 29452 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.234941 29452 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:36:09.235051 29445 raft_consensus.cc:348] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.235123 29445 raft_consensus.cc:374] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.235143 29445 raft_consensus.cc:729] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d65f7c59704cf7942eab366ffe6efa, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.235188 29445 consensus_queue.cc:260] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.235253 29449 tablet_bootstrap.cc:492] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: No bootstrap required, opened a new log
I20260808 14:36:09.235265 29445 ts_tablet_manager.cc:1428] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:09.235302 29449 ts_tablet_manager.cc:1397] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:36:09.235409 29450 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.235471 29450 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:36:09.235451 29449 raft_consensus.cc:348] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.235532 29449 raft_consensus.cc:374] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.235556 29449 raft_consensus.cc:729] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf8bfedd66048d192199782108b96e6, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.235617 29449 consensus_queue.cc:260] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.235713 29449 ts_tablet_manager.cc:1428] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:09.235960 29453 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.236065 29453 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:36:09.304060 29453 raft_consensus.cc:482] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:09.304167 29453 raft_consensus.cc:504] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.304352 29453 leader_election.cc:288] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005), 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573)
I20260808 14:36:09.304584 29214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973cc334f49c45458358adcafb0d1253" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9081b0f32e4956b4ccc7442c28689b" is_pre_election: true
I20260808 14:36:09.304610 29366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973cc334f49c45458358adcafb0d1253" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d65f7c59704cf7942eab366ffe6efa" is_pre_election: true
I20260808 14:36:09.304699 29214 raft_consensus.cc:2454] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 0.
I20260808 14:36:09.304736 29366 raft_consensus.cc:2454] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 0.
I20260808 14:36:09.304888 28992 leader_election.cc:302] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9081b0f32e4956b4ccc7442c28689b, dbf8bfedd66048d192199782108b96e6; no voters:
I20260808 14:36:09.305012 29453 raft_consensus.cc:2781] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:09.305066 29453 raft_consensus.cc:482] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:09.305089 29453 raft_consensus.cc:3037] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.305742 29453 raft_consensus.cc:504] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.305882 29453 leader_election.cc:288] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005), 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573)
I20260808 14:36:09.306047 29214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973cc334f49c45458358adcafb0d1253" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9081b0f32e4956b4ccc7442c28689b"
I20260808 14:36:09.306123 29214 raft_consensus.cc:3037] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.306699 29214 raft_consensus.cc:2454] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 1.
I20260808 14:36:09.306828 29366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973cc334f49c45458358adcafb0d1253" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d65f7c59704cf7942eab366ffe6efa"
I20260808 14:36:09.306862 28992 leader_election.cc:302] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9081b0f32e4956b4ccc7442c28689b, dbf8bfedd66048d192199782108b96e6; no voters:
I20260808 14:36:09.306913 29366 raft_consensus.cc:3037] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.306954 29453 raft_consensus.cc:2781] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:09.307004 29453 raft_consensus.cc:686] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [term 1 LEADER]: Becoming Leader. State: Replica: dbf8bfedd66048d192199782108b96e6, State: Running, Role: LEADER
I20260808 14:36:09.307054 29453 consensus_queue.cc:237] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.307399 29477 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: TxnStatusTablet state changed. Reason: New leader dbf8bfedd66048d192199782108b96e6. Latest consensus state: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.307523 29477 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:36:09.307682 28896 catalog_manager.cc:5495] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbf8bfedd66048d192199782108b96e6 (127.20.81.1). New cstate: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:09.307752 29366 raft_consensus.cc:2454] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 1.
I20260808 14:36:09.308068 29490 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:36:09.308216 29490 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:36:09.327132 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.324349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43212 (local address 127.20.81.1:36507)
0808 14:36:09.324401 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.324408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.324420 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:36:09.324457 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.324458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.324477 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.324596 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:09.324737 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.325379 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.326227 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.326447 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.326528 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.326731 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:09.326842 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:09.326942 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.327021 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.327045 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:36:09.327142 29484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.324048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:36507 (local address 127.0.0.1:43212)
0808 14:36:09.324142 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.324156 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:09.324216 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:09.324595 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:09.324596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:09.324597 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:36:09.324654 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.324657 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.325490 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.325492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.326127 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.326130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.326530 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.326531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.326604 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.326628 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:36:09.326943 (+ 315us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:36:09.326955 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:36:09.327004 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:36:09.327063 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 14:36:09.328639 29366 raft_consensus.cc:1261] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Refusing update from remote peer dbf8bfedd66048d192199782108b96e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.328694 29214 raft_consensus.cc:1261] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Refusing update from remote peer dbf8bfedd66048d192199782108b96e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.328903 29477 consensus_queue.cc:1035] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.329048 29453 consensus_queue.cc:1035] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.329711 29450 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: TxnStatusTablet state changed. Reason: New leader dbf8bfedd66048d192199782108b96e6. Latest consensus state: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.329728 29452 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: TxnStatusTablet state changed. Reason: New leader dbf8bfedd66048d192199782108b96e6. Latest consensus state: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.329806 29450 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:36:09.329814 29452 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:36:09.330603 29477 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.330686 29477 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:36:09.331120 29452 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.331207 29452 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P 8f9081b0f32e4956b4ccc7442c28689b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:36:09.331319 29477 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.331391 29477 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P dbf8bfedd66048d192199782108b96e6: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:36:09.331775 29450 tablet_replica.cc:439] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } } }
I20260808 14:36:09.331862 29450 tablet_replica.cc:442] T 973cc334f49c45458358adcafb0d1253 P 80d65f7c59704cf7942eab366ffe6efa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:36:09.335346 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.332976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43222 (local address 127.20.81.1:36507)
0808 14:36:09.333029 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.333031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.333040 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:09.333103 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.333104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.333114 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.333168 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:09.333270 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.333722 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.334648 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.334848 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.334917 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.335072 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:09.335104 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:09.335169 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.335231 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.335250 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:36:09.342180 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.338262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:56953 (local address 127.20.81.1:36507)
0808 14:36:09.338300 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.338302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.338428 (+ 126us) server_negotiation.cc:407] Connection header received
0808 14:36:09.338456 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.338457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.338465 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.338570 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:09.338717 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.339182 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.341380 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.341566 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.341633 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.341824 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:09.341848 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:09.341885 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.342079 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.342098 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:36:09.342254 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.338164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:36507 (local address 127.20.81.1:56953)
0808 14:36:09.338333 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.338343 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:09.338404 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:09.338575 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:09.338575 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:09.338577 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:36:09.338643 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.338644 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.339266 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.339267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.341277 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.341281 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.341647 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.341648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.341718 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.341736 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:36:09.341905 (+ 169us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:36:09.341907 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:36:09.342030 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 14:36:09.342080 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":82,"threads_started":1}
I20260808 14:36:09.345052 29366 raft_consensus.cc:1261] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Refusing update from remote peer dbf8bfedd66048d192199782108b96e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.345099 29214 raft_consensus.cc:1261] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Refusing update from remote peer dbf8bfedd66048d192199782108b96e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.345340 29453 consensus_queue.cc:1035] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.345458 29495 consensus_queue.cc:1035] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.358011 28896 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:09.358106 28896 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:09.358724 28896 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: Sending DeleteTablet for 3 replicas of tablet 0f8802fe51bb4d3cbee821ec9d73a972
I20260808 14:36:09.358991 29045 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8802fe51bb4d3cbee821ec9d73a972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:43208
I20260808 14:36:09.358978 29192 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8802fe51bb4d3cbee821ec9d73a972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:60876
I20260808 14:36:09.359025 29344 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8802fe51bb4d3cbee821ec9d73a972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:35978
I20260808 14:36:09.359094 29471 tablet_replica.cc:330] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: stopping tablet replica
I20260808 14:36:09.359119 29470 tablet_replica.cc:330] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: stopping tablet replica
I20260808 14:36:09.359143 29471 raft_consensus.cc:2229] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:09.359169 29470 raft_consensus.cc:2229] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:09.359179 29471 raft_consensus.cc:2258] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.359256 29470 raft_consensus.cc:2258] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.359339 29469 tablet_replica.cc:330] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: stopping tablet replica
I20260808 14:36:09.359392 29469 raft_consensus.cc:2229] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:09.359427 29469 raft_consensus.cc:2258] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.359597 29471 ts_tablet_manager.cc:1905] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.359591 29470 ts_tablet_manager.cc:1905] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.361091 29471 ts_tablet_manager.cc:1918] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:36:09.361147 29471 log.cc:1196] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/0f8802fe51bb4d3cbee821ec9d73a972
I20260808 14:36:09.361382 29471 ts_tablet_manager.cc:1939] T 0f8802fe51bb4d3cbee821ec9d73a972 P 8f9081b0f32e4956b4ccc7442c28689b: Deleting consensus metadata
I20260808 14:36:09.361519 29470 ts_tablet_manager.cc:1918] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:36:09.361574 29470 log.cc:1196] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/0f8802fe51bb4d3cbee821ec9d73a972
I20260808 14:36:09.361720 28878 catalog_manager.cc:4841] TS 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005): tablet 0f8802fe51bb4d3cbee821ec9d73a972 (table test-table [id=64dbc7b9d1924e2983ace51a724692e7]) successfully deleted
I20260808 14:36:09.361797 29470 ts_tablet_manager.cc:1939] T 0f8802fe51bb4d3cbee821ec9d73a972 P dbf8bfedd66048d192199782108b96e6: Deleting consensus metadata
I20260808 14:36:09.362370 28882 catalog_manager.cc:4841] TS dbf8bfedd66048d192199782108b96e6 (127.20.81.1:36507): tablet 0f8802fe51bb4d3cbee821ec9d73a972 (table test-table [id=64dbc7b9d1924e2983ace51a724692e7]) successfully deleted
I20260808 14:36:09.362912 29469 ts_tablet_manager.cc:1905] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.364245 29469 ts_tablet_manager.cc:1918] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:36:09.364298 29469 log.cc:1196] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/0f8802fe51bb4d3cbee821ec9d73a972
I20260808 14:36:09.364509 29469 ts_tablet_manager.cc:1939] T 0f8802fe51bb4d3cbee821ec9d73a972 P 80d65f7c59704cf7942eab366ffe6efa: Deleting consensus metadata
I20260808 14:36:09.364888 28877 catalog_manager.cc:4841] TS 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573): tablet 0f8802fe51bb4d3cbee821ec9d73a972 (table test-table [id=64dbc7b9d1924e2983ace51a724692e7]) successfully deleted
Aug 08 14:36:09 dist-test-slave-8n49 krb5kdc[28847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:36:09 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:09 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:36:09.389873 28949 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:09.383746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48588 (local address 127.20.81.62:46041)
0808 14:36:09.383819 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.383821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.384002 (+ 181us) server_negotiation.cc:407] Connection header received
0808 14:36:09.384039 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.384039 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.384052 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.384104 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:09.384854 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.385395 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.386443 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.386631 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.386685 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.389802 (+ 3117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48588: BlockingRecv error: recv got EOF from 127.0.0.1:48588 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 14:36:09 dist-test-slave-8n49 krb5kdc[28847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM
I20260808 14:36:09.397635 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.390627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48602 (local address 127.20.81.62:46041)
0808 14:36:09.390666 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.390668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.390777 (+ 109us) server_negotiation.cc:407] Connection header received
0808 14:36:09.390852 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.390853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.390862 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.390927 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:09.391383 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.391840 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.392512 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.392752 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.392825 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.394904 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:09.394905 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:09.394906 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:09.394913 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:09.396456 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:09.396877 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:09.396879 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:09.396879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:09.396944 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:09.397138 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:09.397140 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:09.397140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:09.397275 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:09.397372 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.397459 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.397534 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:36:09.399281 28896 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:09.399480 28896 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:09.401047 29192 tablet_service.cc:1467] Processing CreateTablet for tablet b794f23889c64b4b8e687383a185827e (DEFAULT_TABLE table=test-table [id=eba4224bea7644579c736b19cb362fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:09.401046 29045 tablet_service.cc:1467] Processing CreateTablet for tablet b794f23889c64b4b8e687383a185827e (DEFAULT_TABLE table=test-table [id=eba4224bea7644579c736b19cb362fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:09.401185 29045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b794f23889c64b4b8e687383a185827e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.401193 29192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b794f23889c64b4b8e687383a185827e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.402230 29447 tablet_bootstrap.cc:492] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: Bootstrap starting.
I20260808 14:36:09.402551 29447 tablet_bootstrap.cc:654] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.402590 29449 tablet_bootstrap.cc:492] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: Bootstrap starting.
I20260808 14:36:09.402645 29344 tablet_service.cc:1467] Processing CreateTablet for tablet b794f23889c64b4b8e687383a185827e (DEFAULT_TABLE table=test-table [id=eba4224bea7644579c736b19cb362fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:09.402776 29344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b794f23889c64b4b8e687383a185827e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.403007 29449 tablet_bootstrap.cc:654] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.403465 29447 tablet_bootstrap.cc:492] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: No bootstrap required, opened a new log
I20260808 14:36:09.403528 29447 ts_tablet_manager.cc:1397] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:36:09.403650 29447 raft_consensus.cc:348] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.403721 29447 raft_consensus.cc:374] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.403739 29447 raft_consensus.cc:729] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9081b0f32e4956b4ccc7442c28689b, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.403779 29447 consensus_queue.cc:260] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.403851 29447 ts_tablet_manager.cc:1428] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:09.404405 29449 tablet_bootstrap.cc:492] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: No bootstrap required, opened a new log
I20260808 14:36:09.404475 29449 ts_tablet_manager.cc:1397] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:36:09.404538 29445 tablet_bootstrap.cc:492] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: Bootstrap starting.
I20260808 14:36:09.404685 29449 raft_consensus.cc:348] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.404764 29449 raft_consensus.cc:374] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.404788 29449 raft_consensus.cc:729] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf8bfedd66048d192199782108b96e6, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.404834 29449 consensus_queue.cc:260] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.404935 29449 ts_tablet_manager.cc:1428] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:09.405016 29445 tablet_bootstrap.cc:654] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.406019 29445 tablet_bootstrap.cc:492] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: No bootstrap required, opened a new log
I20260808 14:36:09.406076 29445 ts_tablet_manager.cc:1397] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:36:09.406225 29445 raft_consensus.cc:348] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.406307 29445 raft_consensus.cc:374] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.406332 29445 raft_consensus.cc:729] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d65f7c59704cf7942eab366ffe6efa, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.406383 29445 consensus_queue.cc:260] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.406482 29445 ts_tablet_manager.cc:1428] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:09.636176 29450 raft_consensus.cc:482] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:09.636327 29450 raft_consensus.cc:504] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.636767 29450 leader_election.cc:288] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbf8bfedd66048d192199782108b96e6 (127.20.81.1:36507), 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005)
I20260808 14:36:09.640317 29442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.637186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:60135 (local address 127.20.81.2:37005)
0808 14:36:09.637246 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.637248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.637261 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:36:09.637319 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.637320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.637331 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.637409 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:09.637599 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.638321 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.639457 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.639942 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.639999 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.640009 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.640201 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.640231 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:36:09.640341 29519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.637004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:37005 (local address 127.20.81.3:60135)
0808 14:36:09.637181 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.637194 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:09.637257 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:09.637409 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:09.637410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:09.637413 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:09.637511 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.637513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.638415 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.638416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.639345 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.639348 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.640049 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.640051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.640121 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.640126 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:36:09.640187 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:36:09.640230 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":73,"threads_started":1}
I20260808 14:36:09.640655 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.637113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:52457 (local address 127.20.81.1:36507)
0808 14:36:09.637192 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.637196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.637326 (+ 130us) server_negotiation.cc:407] Connection header received
0808 14:36:09.637401 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.637402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.637411 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.637468 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:09.638053 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.638681 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.639758 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.640217 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.640278 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.640288 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.640478 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.640526 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:36:09.640789 29214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b794f23889c64b4b8e687383a185827e" candidate_uuid: "80d65f7c59704cf7942eab366ffe6efa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9081b0f32e4956b4ccc7442c28689b" is_pre_election: true
I20260808 14:36:09.640902 29520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.637004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:36507 (local address 127.20.81.3:52457)
0808 14:36:09.637217 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.637231 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:09.637321 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:09.637492 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:09.637493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:09.637496 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:09.637945 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.637948 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.638807 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.638808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.639665 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:09.639668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.640295 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.640296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:09.640372 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.640378 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:36:09.640768 (+ 390us) client_negotiation.cc:240] Negotiation successful
0808 14:36:09.640811 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":2,"thread_start_us":72,"threads_started":1}
I20260808 14:36:09.640908 29214 raft_consensus.cc:2454] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d65f7c59704cf7942eab366ffe6efa in term 0.
I20260808 14:36:09.641175 29295 leader_election.cc:302] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80d65f7c59704cf7942eab366ffe6efa, 8f9081b0f32e4956b4ccc7442c28689b; no voters:
I20260808 14:36:09.641196 29066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b794f23889c64b4b8e687383a185827e" candidate_uuid: "80d65f7c59704cf7942eab366ffe6efa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbf8bfedd66048d192199782108b96e6" is_pre_election: true
I20260808 14:36:09.641296 29066 raft_consensus.cc:2454] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d65f7c59704cf7942eab366ffe6efa in term 0.
I20260808 14:36:09.641305 29450 raft_consensus.cc:2781] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:09.641341 29450 raft_consensus.cc:482] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:09.641366 29450 raft_consensus.cc:3037] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.642099 29450 raft_consensus.cc:504] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.642253 29450 leader_election.cc:288] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [CANDIDATE]: Term 1 election: Requested vote from peers dbf8bfedd66048d192199782108b96e6 (127.20.81.1:36507), 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005)
I20260808 14:36:09.642401 29214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b794f23889c64b4b8e687383a185827e" candidate_uuid: "80d65f7c59704cf7942eab366ffe6efa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9081b0f32e4956b4ccc7442c28689b"
I20260808 14:36:09.642405 29066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b794f23889c64b4b8e687383a185827e" candidate_uuid: "80d65f7c59704cf7942eab366ffe6efa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbf8bfedd66048d192199782108b96e6"
I20260808 14:36:09.642477 29214 raft_consensus.cc:3037] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.642503 29066 raft_consensus.cc:3037] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.643136 29214 raft_consensus.cc:2454] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d65f7c59704cf7942eab366ffe6efa in term 1.
I20260808 14:36:09.643257 29066 raft_consensus.cc:2454] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d65f7c59704cf7942eab366ffe6efa in term 1.
I20260808 14:36:09.643293 29295 leader_election.cc:302] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80d65f7c59704cf7942eab366ffe6efa, 8f9081b0f32e4956b4ccc7442c28689b; no voters:
I20260808 14:36:09.643375 29450 raft_consensus.cc:2781] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:09.643488 29450 raft_consensus.cc:686] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 1 LEADER]: Becoming Leader. State: Replica: 80d65f7c59704cf7942eab366ffe6efa, State: Running, Role: LEADER
I20260808 14:36:09.643576 29450 consensus_queue.cc:237] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.644345 28895 catalog_manager.cc:5495] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3). New cstate: current_term: 1 leader_uuid: "80d65f7c59704cf7942eab366ffe6efa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } health_report { overall_health: HEALTHY } } }
I20260808 14:36:09.688457 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.685956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35984 (local address 127.20.81.3:40573)
0808 14:36:09.686083 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.686085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.686092 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:09.686132 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.686132 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.686153 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.686240 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:09.686389 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.686879 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.687659 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.687858 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.687934 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.688096 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:09.688209 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:09.688295 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.688337 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.688358 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":49,"threads_started":1}
I20260808 14:36:09.689584 29066 raft_consensus.cc:1261] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Refusing update from remote peer 80d65f7c59704cf7942eab366ffe6efa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.689595 29214 raft_consensus.cc:1261] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Refusing update from remote peer 80d65f7c59704cf7942eab366ffe6efa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.689857 29450 consensus_queue.cc:1035] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.689990 29521 consensus_queue.cc:1035] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.693660 28895 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:09.693754 28895 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:09.694444 28895 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: Sending DeleteTablet for 3 replicas of tablet b794f23889c64b4b8e687383a185827e
I20260808 14:36:09.694732 29045 tablet_service.cc:1514] Processing DeleteTablet for tablet b794f23889c64b4b8e687383a185827e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:43208
I20260808 14:36:09.694731 29344 tablet_service.cc:1514] Processing DeleteTablet for tablet b794f23889c64b4b8e687383a185827e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:35978
I20260808 14:36:09.694765 29192 tablet_service.cc:1514] Processing DeleteTablet for tablet b794f23889c64b4b8e687383a185827e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:60876
I20260808 14:36:09.694823 29470 tablet_replica.cc:330] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: stopping tablet replica
I20260808 14:36:09.694823 29469 tablet_replica.cc:330] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: stopping tablet replica
I20260808 14:36:09.694861 29471 tablet_replica.cc:330] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: stopping tablet replica
I20260808 14:36:09.694871 29469 raft_consensus.cc:2229] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:09.694873 29470 raft_consensus.cc:2229] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:09.694911 29471 raft_consensus.cc:2229] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:09.694917 29470 raft_consensus.cc:2258] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.694950 29471 raft_consensus.cc:2258] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.694952 29469 raft_consensus.cc:2258] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.695225 29469 ts_tablet_manager.cc:1905] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.695259 29470 ts_tablet_manager.cc:1905] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.695518 28895 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:09.695660 28895 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:09.696743 29469 ts_tablet_manager.cc:1918] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:09.696743 29470 ts_tablet_manager.cc:1918] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:09.696807 29469 log.cc:1196] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/b794f23889c64b4b8e687383a185827e
I20260808 14:36:09.696807 29470 log.cc:1196] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/b794f23889c64b4b8e687383a185827e
I20260808 14:36:09.696798 29471 ts_tablet_manager.cc:1905] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.697048 29470 ts_tablet_manager.cc:1939] T b794f23889c64b4b8e687383a185827e P dbf8bfedd66048d192199782108b96e6: Deleting consensus metadata
I20260808 14:36:09.697048 29469 ts_tablet_manager.cc:1939] T b794f23889c64b4b8e687383a185827e P 80d65f7c59704cf7942eab366ffe6efa: Deleting consensus metadata
I20260808 14:36:09.697387 29344 tablet_service.cc:1467] Processing CreateTablet for tablet a87699c735c241fa9434b07198ff624f (DEFAULT_TABLE table=test-table [id=fadc3e6cfe184975a5ce48b0e7919168]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:09.697387 29045 tablet_service.cc:1467] Processing CreateTablet for tablet a87699c735c241fa9434b07198ff624f (DEFAULT_TABLE table=test-table [id=fadc3e6cfe184975a5ce48b0e7919168]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:09.697429 29192 tablet_service.cc:1467] Processing CreateTablet for tablet a87699c735c241fa9434b07198ff624f (DEFAULT_TABLE table=test-table [id=fadc3e6cfe184975a5ce48b0e7919168]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:09.697489 29344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87699c735c241fa9434b07198ff624f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.697489 29045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87699c735c241fa9434b07198ff624f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.697537 29192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87699c735c241fa9434b07198ff624f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:09.698372 29471 ts_tablet_manager.cc:1918] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:09.698419 29471 log.cc:1196] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/b794f23889c64b4b8e687383a185827e
I20260808 14:36:09.698637 29471 ts_tablet_manager.cc:1939] T b794f23889c64b4b8e687383a185827e P 8f9081b0f32e4956b4ccc7442c28689b: Deleting consensus metadata
I20260808 14:36:09.698655 29445 tablet_bootstrap.cc:492] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: Bootstrap starting.
I20260808 14:36:09.698956 29449 tablet_bootstrap.cc:492] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6: Bootstrap starting.
I20260808 14:36:09.699090 29445 tablet_bootstrap.cc:654] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.699254 29449 tablet_bootstrap.cc:654] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.699512 29447 tablet_bootstrap.cc:492] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: Bootstrap starting.
I20260808 14:36:09.699721 29445 tablet_bootstrap.cc:492] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: No bootstrap required, opened a new log
I20260808 14:36:09.699769 29445 ts_tablet_manager.cc:1397] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:09.699805 29447 tablet_bootstrap.cc:654] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:09.699891 29445 raft_consensus.cc:348] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.699940 29445 raft_consensus.cc:374] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.699954 29445 raft_consensus.cc:729] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d65f7c59704cf7942eab366ffe6efa, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.700016 29445 consensus_queue.cc:260] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.700111 29445 ts_tablet_manager.cc:1428] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:09.700153 28878 catalog_manager.cc:4841] TS 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005): tablet b794f23889c64b4b8e687383a185827e (table test-table [id=eba4224bea7644579c736b19cb362fee]) successfully deleted
I20260808 14:36:09.700196 28882 catalog_manager.cc:4841] TS dbf8bfedd66048d192199782108b96e6 (127.20.81.1:36507): tablet b794f23889c64b4b8e687383a185827e (table test-table [id=eba4224bea7644579c736b19cb362fee]) successfully deleted
I20260808 14:36:09.700165 28877 catalog_manager.cc:4841] TS 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573): tablet b794f23889c64b4b8e687383a185827e (table test-table [id=eba4224bea7644579c736b19cb362fee]) successfully deleted
I20260808 14:36:09.700929 29449 tablet_bootstrap.cc:492] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6: No bootstrap required, opened a new log
I20260808 14:36:09.701004 29449 ts_tablet_manager.cc:1397] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:36:09.701123 29449 raft_consensus.cc:348] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.701172 29449 raft_consensus.cc:374] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.701184 29449 raft_consensus.cc:729] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf8bfedd66048d192199782108b96e6, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.701239 29449 consensus_queue.cc:260] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.701333 29449 ts_tablet_manager.cc:1428] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:09.701928 29447 tablet_bootstrap.cc:492] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: No bootstrap required, opened a new log
I20260808 14:36:09.702008 29447 ts_tablet_manager.cc:1397] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 14:36:09.702167 29447 raft_consensus.cc:348] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.702291 29447 raft_consensus.cc:374] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:09.702318 29447 raft_consensus.cc:729] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9081b0f32e4956b4ccc7442c28689b, State: Initialized, Role: FOLLOWER
I20260808 14:36:09.702375 29447 consensus_queue.cc:260] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.702477 29447 ts_tablet_manager.cc:1428] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:09.775717 29503 raft_consensus.cc:482] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:09.775818 29503 raft_consensus.cc:504] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.776018 29503 leader_election.cc:288] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005), 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573)
I20260808 14:36:09.776180 29214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87699c735c241fa9434b07198ff624f" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9081b0f32e4956b4ccc7442c28689b" is_pre_election: true
I20260808 14:36:09.776237 29366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87699c735c241fa9434b07198ff624f" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d65f7c59704cf7942eab366ffe6efa" is_pre_election: true
I20260808 14:36:09.776286 29214 raft_consensus.cc:2454] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 0.
I20260808 14:36:09.776317 29366 raft_consensus.cc:2454] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 0.
I20260808 14:36:09.776465 28992 leader_election.cc:302] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9081b0f32e4956b4ccc7442c28689b, dbf8bfedd66048d192199782108b96e6; no voters:
I20260808 14:36:09.776580 29503 raft_consensus.cc:2781] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:09.776643 29503 raft_consensus.cc:482] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:09.776672 29503 raft_consensus.cc:3037] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.777446 29503 raft_consensus.cc:504] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.777599 29503 leader_election.cc:288] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005), 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573)
I20260808 14:36:09.777760 29214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87699c735c241fa9434b07198ff624f" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9081b0f32e4956b4ccc7442c28689b"
I20260808 14:36:09.777796 29366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87699c735c241fa9434b07198ff624f" candidate_uuid: "dbf8bfedd66048d192199782108b96e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d65f7c59704cf7942eab366ffe6efa"
I20260808 14:36:09.777835 29214 raft_consensus.cc:3037] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.777856 29366 raft_consensus.cc:3037] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:09.778429 29366 raft_consensus.cc:2454] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 1.
I20260808 14:36:09.778586 28991 leader_election.cc:302] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80d65f7c59704cf7942eab366ffe6efa, dbf8bfedd66048d192199782108b96e6; no voters:
I20260808 14:36:09.778688 29503 raft_consensus.cc:2781] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:09.778733 29503 raft_consensus.cc:686] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 1 LEADER]: Becoming Leader. State: Replica: dbf8bfedd66048d192199782108b96e6, State: Running, Role: LEADER
I20260808 14:36:09.778741 29214 raft_consensus.cc:2454] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbf8bfedd66048d192199782108b96e6 in term 1.
I20260808 14:36:09.778779 29503 consensus_queue.cc:237] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } }
I20260808 14:36:09.779363 28896 catalog_manager.cc:5495] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbf8bfedd66048d192199782108b96e6 (127.20.81.1). New cstate: current_term: 1 leader_uuid: "dbf8bfedd66048d192199782108b96e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf8bfedd66048d192199782108b96e6" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 36507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:09.800745 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.797776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43230 (local address 127.20.81.1:36507)
0808 14:36:09.797823 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:09.797825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:09.797836 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:36:09.797911 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:09.797912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:09.797922 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:09.798019 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:09.798204 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.798853 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.799962 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:09.800207 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:09.800267 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:09.800445 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:09.800474 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:09.800513 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:09.800628 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 14:36:09.800647 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:36:09.803428 29214 raft_consensus.cc:1261] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Refusing update from remote peer dbf8bfedd66048d192199782108b96e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.803431 29366 raft_consensus.cc:1261] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Refusing update from remote peer dbf8bfedd66048d192199782108b96e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:09.803615 29503 consensus_queue.cc:1035] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d65f7c59704cf7942eab366ffe6efa" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.803725 29503 consensus_queue.cc:1035] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9081b0f32e4956b4ccc7442c28689b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:09.815059 28895 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:09.815186 28895 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:09.815860 28895 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8482fea0f24c431b85070dd4f7fc080b: Sending DeleteTablet for 3 replicas of tablet a87699c735c241fa9434b07198ff624f
I20260808 14:36:09.816154 29344 tablet_service.cc:1514] Processing DeleteTablet for tablet a87699c735c241fa9434b07198ff624f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:35978
I20260808 14:36:09.816172 29044 tablet_service.cc:1514] Processing DeleteTablet for tablet a87699c735c241fa9434b07198ff624f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:43208
I20260808 14:36:09.816174 29192 tablet_service.cc:1514] Processing DeleteTablet for tablet a87699c735c241fa9434b07198ff624f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:09 UTC) from {username='oryx', principal='oryx/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:60876
I20260808 14:36:09.816257 29469 tablet_replica.cc:330] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: stopping tablet replica
I20260808 14:36:09.816284 29471 tablet_replica.cc:330] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: stopping tablet replica
I20260808 14:36:09.816314 29469 raft_consensus.cc:2229] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:09.816342 29471 raft_consensus.cc:2229] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:09.816350 29469 raft_consensus.cc:2258] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.816386 29471 raft_consensus.cc:2258] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.816421 29470 tablet_replica.cc:330] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6: stopping tablet replica
I20260808 14:36:09.816488 29470 raft_consensus.cc:2229] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:09.816576 29470 raft_consensus.cc:2258] T a87699c735c241fa9434b07198ff624f P dbf8bfedd66048d192199782108b96e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:09.816777 29471 ts_tablet_manager.cc:1905] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.816954 29469 ts_tablet_manager.cc:1905] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:09.817101 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 28973
I20260808 14:36:09.818631 29471 ts_tablet_manager.cc:1918] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:36:09.818686 29471 log.cc:1196] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/a87699c735c241fa9434b07198ff624f
I20260808 14:36:09.818895 29471 ts_tablet_manager.cc:1939] T a87699c735c241fa9434b07198ff624f P 8f9081b0f32e4956b4ccc7442c28689b: Deleting consensus metadata
I20260808 14:36:09.819056 29469 ts_tablet_manager.cc:1918] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:36:09.819119 29469 log.cc:1196] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/a87699c735c241fa9434b07198ff624f
I20260808 14:36:09.819337 29469 ts_tablet_manager.cc:1939] T a87699c735c241fa9434b07198ff624f P 80d65f7c59704cf7942eab366ffe6efa: Deleting consensus metadata
I20260808 14:36:09.819532 28878 catalog_manager.cc:4841] TS 8f9081b0f32e4956b4ccc7442c28689b (127.20.81.2:37005): tablet a87699c735c241fa9434b07198ff624f (table test-table [id=fadc3e6cfe184975a5ce48b0e7919168]) successfully deleted
I20260808 14:36:09.819635 28877 catalog_manager.cc:4841] TS 80d65f7c59704cf7942eab366ffe6efa (127.20.81.3:40573): tablet a87699c735c241fa9434b07198ff624f (table test-table [id=fadc3e6cfe184975a5ce48b0e7919168]) successfully deleted
W20260808 14:36:09.827217 28882 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:36507 (error 108)
I20260808 14:36:09.827569 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 29125
I20260808 14:36:09.829934 29537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:09.827613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:36507 (local address 127.0.0.1:43238)
0808 14:36:09.829850 (+ 2237us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:09.829895 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:36507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2219,"thread_start_us":61,"threads_started":1}
W20260808 14:36:09.830157 28882 catalog_manager.cc:4584] TS dbf8bfedd66048d192199782108b96e6 (127.20.81.1:36507): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a87699c735c241fa9434b07198ff624f: Network error: Client connection negotiation failed: client connection to 127.20.81.1:36507: connect: Connection refused (error 111)
I20260808 14:36:09.837054 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 29275
I20260808 14:36:09.844095 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 28860
2026-08-08T14:36:09Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2969 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:09 dist-test-slave-8n49 krb5kdc[29540](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:09 dist-test-slave-8n49 krb5kdc[29540](info): set up 2 sockets
Aug 08 14:36:09 dist-test-slave-8n49 krb5kdc[29540](info): commencing operation
krb5kdc: starting...
W20260808 14:36:10.924721 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:36:11 dist-test-slave-8n49 krb5kdc[29540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:36:11.061704 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34061
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:39861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:34061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:11.155319 29553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:11.155524 29553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:11.155553 29553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:11.156733 29553 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:11.156773 29553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:11.156787 29553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:11.156831 29553 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:11.156862 29553 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:11.158331 29553 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:39861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:34061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:11.158588 29553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:11.158842 29553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:11.163769 29559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:11.163751 29561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:11.163735 29558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:11.164040 29553 server_base.cc:1034] running on GCE node
I20260808 14:36:11.164355 29553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:11.164719 29553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:11.165896 29553 hybrid_clock.cc:648] HybridClock initialized: now 1786199771165878 us; error 27 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T14:36:11Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1323 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:11 dist-test-slave-8n49 krb5kdc[29566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:11 dist-test-slave-8n49 krb5kdc[29566](info): set up 2 sockets
Aug 08 14:36:11 dist-test-slave-8n49 krb5kdc[29566](info): commencing operation
krb5kdc: starting...
W20260808 14:36:12.421530 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:36:12 dist-test-slave-8n49 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:36:12.547173 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35849
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:35849
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:12.630071 29581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:12.630275 29581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:12.630296 29581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:12.631368 29581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:12.631403 29581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:12.631417 29581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:12.631430 29581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:12.631443 29581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:12.632951 29581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:35849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:12.633150 29581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:12.633317 29581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:12.638208 29586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:12.638199 29587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:12.638203 29589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:12.638504 29581 server_base.cc:1034] running on GCE node
I20260808 14:36:12.638808 29581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:12.639118 29581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:12.640293 29581 hybrid_clock.cc:648] HybridClock initialized: now 1786199772640280 us; error 49 us; skew 500 ppm
Aug 08 14:36:12 dist-test-slave-8n49 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199772, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:12.642866 29581 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:36:12.643266 29581 webserver.cc:460] Webserver started at http://127.20.81.62:34775/ using document root <none> and password file <none>
I20260808 14:36:12.643450 29581 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:12.643491 29581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:12.643579 29581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:12.644682 29581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "d88e15f808a4483ba85e39fcad1367aa"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "d85bd0fda87816c12bcf2e850870c524"
server_key_iv: "acae53ec4e9825161e64e68b4c321dfb"
server_key_version: "encryptionkey@0"
I20260808 14:36:12.645011 29581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "d88e15f808a4483ba85e39fcad1367aa"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "d85bd0fda87816c12bcf2e850870c524"
server_key_iv: "acae53ec4e9825161e64e68b4c321dfb"
server_key_version: "encryptionkey@0"
I20260808 14:36:12.646289 29581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:12.647004 29596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:12.647192 29581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:12.647285 29581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "d88e15f808a4483ba85e39fcad1367aa"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "d85bd0fda87816c12bcf2e850870c524"
server_key_iv: "acae53ec4e9825161e64e68b4c321dfb"
server_key_version: "encryptionkey@0"
I20260808 14:36:12.647356 29581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:12.669306 29581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:12.671294 29581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:12.671463 29581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:12.675730 29581 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:35849
I20260808 14:36:12.675806 29651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:35849 every 8 connection(s)
I20260808 14:36:12.676177 29581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:12.677165 29653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:12.679433 29653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: Bootstrap starting.
I20260808 14:36:12.679975 29653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:12.680228 29653 log.cc:824] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:12.680972 29653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: No bootstrap required, opened a new log
I20260808 14:36:12.682443 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 29581
I20260808 14:36:12.682572 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:36:12.682780 20804 external_mini_cluster.cc:1428] Setting key f271fad782523ceb01e504af225aef0e
I20260808 14:36:12.682806 29653 raft_consensus.cc:348] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } }
I20260808 14:36:12.682987 29653 raft_consensus.cc:374] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:12.683027 29653 raft_consensus.cc:729] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d88e15f808a4483ba85e39fcad1367aa, State: Initialized, Role: FOLLOWER
I20260808 14:36:12.683192 29653 consensus_queue.cc:260] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } }
I20260808 14:36:12.683305 29653 raft_consensus.cc:388] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:12.683338 29653 raft_consensus.cc:482] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:12.683390 29653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:12.684460 29653 raft_consensus.cc:504] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } }
I20260808 14:36:12.684607 29653 leader_election.cc:302] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d88e15f808a4483ba85e39fcad1367aa; no voters:
I20260808 14:36:12.684794 29653 leader_election.cc:288] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:12.684856 29658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:12.685019 29658 raft_consensus.cc:686] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 1 LEADER]: Becoming Leader. State: Replica: d88e15f808a4483ba85e39fcad1367aa, State: Running, Role: LEADER
I20260808 14:36:12.685111 29653 sys_catalog.cc:564] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:12.685143 29658 consensus_queue.cc:237] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } }
I20260808 14:36:12.685599 29659 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d88e15f808a4483ba85e39fcad1367aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } } }
I20260808 14:36:12.685684 29659 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:12.685631 29660 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader d88e15f808a4483ba85e39fcad1367aa. Latest consensus state: current_term: 1 leader_uuid: "d88e15f808a4483ba85e39fcad1367aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } } }
I20260808 14:36:12.685724 29660 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:12.685993 29666 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:12.686538 29666 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:12.689791 29666 catalog_manager.cc:1347] Generated new cluster ID: 130a415d37f1444bb781b204ed9e537b
I20260808 14:36:12.689867 29666 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:36:12 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:12.696127 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:12.683387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37368 (local address 127.20.81.62:35849)
0808 14:36:12.683579 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:12.683588 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:12.683709 (+ 121us) server_negotiation.cc:407] Connection header received
0808 14:36:12.683851 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:12.683858 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:12.683900 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:12.684020 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:12.684932 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:12.686374 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:12.687414 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:12.687995 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:12.688122 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:12.691006 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:12.691010 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:12.691011 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:12.691023 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:12.693166 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:12.693570 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:12.693574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:12.693574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:12.694439 (+ 865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:12.694685 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:12.694685 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:12.694686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:12.695072 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:12.695241 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:12.695765 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 14:36:12.695908 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":97,"threads_started":1}
I20260808 14:36:12.698259 29666 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:12.698753 29666 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:12.705577 29666 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: Generated new TSK 0
I20260808 14:36:12.705758 29666 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:36:12.743773 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35849
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:12.825382 29680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:12.825621 29680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:12.825659 29680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:12.826789 29680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:12.826854 29680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:12.826902 29680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:36:12.828346 29680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:12.828646 29680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:12.828882 29680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:12.833861 29686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:12.834019 29680 server_base.cc:1034] running on GCE node
W20260808 14:36:12.833806 29688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:12.833930 29685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:12.834335 29680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:12.834614 29680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:12.835768 29680 hybrid_clock.cc:648] HybridClock initialized: now 1786199772835755 us; error 28 us; skew 500 ppm
Aug 08 14:36:12 dist-test-slave-8n49 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199772, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:12.838325 29680 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:36:12.838790 29680 webserver.cc:460] Webserver started at http://127.20.81.1:45389/ using document root <none> and password file <none>
I20260808 14:36:12.838995 29680 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:12.839035 29680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:12.839128 29680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:12.840101 29680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "5fb76dada39540ed932edfeaa6a85f63"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "0d1677cc7eab5278bb86f897f3fe4d8a"
server_key_iv: "524318a14a6a26d5fce314c34d157416"
server_key_version: "encryptionkey@0"
I20260808 14:36:12.840428 29680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "5fb76dada39540ed932edfeaa6a85f63"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "0d1677cc7eab5278bb86f897f3fe4d8a"
server_key_iv: "524318a14a6a26d5fce314c34d157416"
server_key_version: "encryptionkey@0"
I20260808 14:36:12.841748 29680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:36:12.842424 29695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:12.842587 29680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:12.842671 29680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "5fb76dada39540ed932edfeaa6a85f63"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "0d1677cc7eab5278bb86f897f3fe4d8a"
server_key_iv: "524318a14a6a26d5fce314c34d157416"
server_key_version: "encryptionkey@0"
I20260808 14:36:12.842738 29680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:12.852465 29680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:12.854244 29680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:12.854394 29680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:12.854620 29680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:12.854926 29680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:12.854977 29680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:12.855017 29680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:12.855046 29680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:12.860688 29680 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:46281
I20260808 14:36:12.860767 29817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:46281 every 8 connection(s)
I20260808 14:36:12.861079 29680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:36:12 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199772, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:12.869243 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 29680
I20260808 14:36:12.869371 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:36:12.869632 20804 external_mini_cluster.cc:1428] Setting key 273c5de65481785291acd2bdd9d467a0
I20260808 14:36:12.870286 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:12.861865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:34783 (local address 127.20.81.62:35849)
0808 14:36:12.861926 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:12.861928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:12.862141 (+ 213us) server_negotiation.cc:407] Connection header received
0808 14:36:12.862640 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:12.862642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:12.862655 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:12.862716 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:12.863655 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:12.864166 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:12.865189 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:12.865385 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:12.865457 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:12.867575 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:12.867577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:12.867577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:12.867584 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:12.868831 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:12.869210 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:12.869211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:12.869212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:12.869281 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:12.869579 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:12.869580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:12.869581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:12.869741 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:12.869821 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:12.870103 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 14:36:12.870196 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:36:12.870481 29820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:12.861826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:34783)
0808 14:36:12.862007 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:12.862049 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:12.862532 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:12.862798 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:12.862802 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:12.863360 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:12.863559 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:12.863564 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:12.864246 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:12.864247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:12.865114 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:12.865117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:12.865463 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:12.865464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:12.865579 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:12.866098 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:12.866107 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:12.867488 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:12.868903 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:12.868909 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:12.868911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:12.869126 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:12.869360 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:12.869360 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:12.869361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:12.869510 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:12.869826 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:12.869833 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:12.869975 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:36:12.870065 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:36:12.870185 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":104,"threads_started":1}
I20260808 14:36:12.870985 29818 heartbeater.cc:347] Connected to a master server at 127.20.81.62:35849
I20260808 14:36:12.871093 29818 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:12.871290 29818 heartbeater.cc:511] Master 127.20.81.62:35849 requested a full tablet report, sending...
I20260808 14:36:12.871861 29613 ts_manager.cc:194] Registered new tserver with Master: 5fb76dada39540ed932edfeaa6a85f63 (127.20.81.1:46281)
I20260808 14:36:12.872838 29613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:34783
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:36:12.897835 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35849
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:12.981036 29823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:12.981225 29823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:12.981245 29823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:12.982381 29823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:12.982419 29823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:12.982445 29823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:36:12.983793 29823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:12.983969 29823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:12.984138 29823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:12.989225 29831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:12.989231 29828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:12.989233 29829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:12.989428 29823 server_base.cc:1034] running on GCE node
I20260808 14:36:12.989622 29823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:12.989869 29823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:12.991048 29823 hybrid_clock.cc:648] HybridClock initialized: now 1786199772991027 us; error 31 us; skew 500 ppm
Aug 08 14:36:12 dist-test-slave-8n49 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199772, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:12.993621 29823 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:36:12.994043 29823 webserver.cc:460] Webserver started at http://127.20.81.2:37067/ using document root <none> and password file <none>
I20260808 14:36:12.994223 29823 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:12.994261 29823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:12.994345 29823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:12.995308 29823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "4a59ee8f07da4348b67f7b1a5e912d54"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "179ed4995ac303e5bfbe44c0a22ff472"
server_key_iv: "a6bc8db74ad8b8f5f044ba8bb5bdf707"
server_key_version: "encryptionkey@0"
I20260808 14:36:12.995618 29823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "4a59ee8f07da4348b67f7b1a5e912d54"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "179ed4995ac303e5bfbe44c0a22ff472"
server_key_iv: "a6bc8db74ad8b8f5f044ba8bb5bdf707"
server_key_version: "encryptionkey@0"
I20260808 14:36:12.996918 29823 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:36:12.997597 29838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:12.997776 29823 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:12.997856 29823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "4a59ee8f07da4348b67f7b1a5e912d54"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "179ed4995ac303e5bfbe44c0a22ff472"
server_key_iv: "a6bc8db74ad8b8f5f044ba8bb5bdf707"
server_key_version: "encryptionkey@0"
I20260808 14:36:12.997910 29823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:13.015053 29823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:13.017352 29823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:13.017467 29823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:13.017656 29823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:13.017968 29823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:13.018003 29823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.018043 29823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:13.018070 29823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.023762 29823 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:38109
I20260808 14:36:13.023847 29958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:38109 every 8 connection(s)
I20260808 14:36:13.024148 29823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199772, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:13.032840 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 29823
I20260808 14:36:13.032971 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:13.033105 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.024959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:54787 (local address 127.20.81.62:35849)
0808 14:36:13.025020 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.025023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.025198 (+ 175us) server_negotiation.cc:407] Connection header received
0808 14:36:13.025686 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.025688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.025697 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.025754 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.026637 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.027126 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.028066 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.028250 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.028300 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.030346 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:13.030348 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:13.030348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:13.030354 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:13.031723 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:13.032072 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:13.032073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:13.032073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:13.032148 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:13.032354 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:13.032355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:13.032355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:13.032470 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:13.032521 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:13.032883 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 14:36:13.033011 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:36:13.033196 20804 external_mini_cluster.cc:1428] Setting key 3db4feb370e929cf95946eea8805de58
I20260808 14:36:13.033281 29962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.024906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:54787)
0808 14:36:13.025073 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.025114 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.025595 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.025806 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.025809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.026366 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.026549 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.026554 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.027201 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.027201 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.027994 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.027996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.028321 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.028322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.028418 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.028876 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.028884 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.030240 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:13.031801 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:13.031806 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:13.031808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:13.032009 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:13.032207 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:13.032208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:13.032208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:13.032301 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:13.032525 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:13.032529 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:13.032736 (+ 207us) client_negotiation.cc:769] Sending connection context
0808 14:36:13.032863 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 14:36:13.033044 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":90,"threads_started":1}
I20260808 14:36:13.033905 29959 heartbeater.cc:347] Connected to a master server at 127.20.81.62:35849
I20260808 14:36:13.034013 29959 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:13.034193 29959 heartbeater.cc:511] Master 127.20.81.62:35849 requested a full tablet report, sending...
I20260808 14:36:13.034590 29613 ts_manager.cc:194] Registered new tserver with Master: 4a59ee8f07da4348b67f7b1a5e912d54 (127.20.81.2:38109)
I20260808 14:36:13.034986 29613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:54787
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:36:13.060098 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35849
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:13.148330 29966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:13.148569 29966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:13.148636 29966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:13.149813 29966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:13.149881 29966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:13.149927 29966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:36:13.151501 29966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:13.151768 29966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:13.152002 29966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:13.156984 29972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.156994 29971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.156994 29974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:13.157306 29966 server_base.cc:1034] running on GCE node
I20260808 14:36:13.157568 29966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:13.157815 29966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:13.158979 29966 hybrid_clock.cc:648] HybridClock initialized: now 1786199773158975 us; error 49 us; skew 500 ppm
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199773, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:13.161530 29966 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:36:13.162034 29966 webserver.cc:460] Webserver started at http://127.20.81.3:42853/ using document root <none> and password file <none>
I20260808 14:36:13.162292 29966 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:13.162360 29966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:13.162513 29966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:13.163589 29966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "fe1d4e88350d4a19b024ae1c5d671057"
format_stamp: "Formatted at 2026-08-08 14:36:13 on dist-test-slave-8n49"
server_key: "551c9c4b0502b062e5c4cf953c198968"
server_key_iv: "8a625bd7241c72548d7333b337269822"
server_key_version: "encryptionkey@0"
I20260808 14:36:13.163962 29966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "fe1d4e88350d4a19b024ae1c5d671057"
format_stamp: "Formatted at 2026-08-08 14:36:13 on dist-test-slave-8n49"
server_key: "551c9c4b0502b062e5c4cf953c198968"
server_key_iv: "8a625bd7241c72548d7333b337269822"
server_key_version: "encryptionkey@0"
I20260808 14:36:13.165410 29966 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:36:13.166242 29981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.166427 29966 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:36:13.166524 29966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "fe1d4e88350d4a19b024ae1c5d671057"
format_stamp: "Formatted at 2026-08-08 14:36:13 on dist-test-slave-8n49"
server_key: "551c9c4b0502b062e5c4cf953c198968"
server_key_iv: "8a625bd7241c72548d7333b337269822"
server_key_version: "encryptionkey@0"
I20260808 14:36:13.166613 29966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:13.182276 29966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:13.184059 29966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:13.184228 29966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:13.184475 29966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:13.184839 29966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:13.184903 29966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.184945 29966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:13.184967 29966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.190984 29966 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:35021
I20260808 14:36:13.191067 30100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:35021 every 8 connection(s)
I20260808 14:36:13.191380 29966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:13.195591 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 29966
I20260808 14:36:13.195750 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:13.195976 20804 external_mini_cluster.cc:1428] Setting key 7f36b6612f289a48cfeee5bf1633a342
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199773, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:13.200531 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.192112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:51983 (local address 127.20.81.62:35849)
0808 14:36:13.192161 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.192164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.192385 (+ 221us) server_negotiation.cc:407] Connection header received
0808 14:36:13.192941 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.192943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.192953 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.193006 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.193886 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.194418 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.195346 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.195553 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.195630 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.197888 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:13.197889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:13.197889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:13.197896 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:13.199296 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:13.199638 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:13.199639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:13.199639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:13.199689 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:13.199892 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:13.199893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:13.199893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:13.199992 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:13.200048 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:13.200332 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 14:36:13.200393 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:36:13.200806 30103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.192107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:51983)
0808 14:36:13.192271 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.192306 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.192853 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.193069 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.193072 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.193627 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.193812 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.193816 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.194497 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.194497 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.195274 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.195276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.195641 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.195642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.195827 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.196367 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.196378 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.197804 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:13.199364 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:13.199369 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:13.199371 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:13.199574 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:13.199746 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:13.199747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:13.199747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:13.199839 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:13.200074 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:13.200081 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:13.200208 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 14:36:13.200307 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:36:13.200429 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260808 14:36:13.201279 30101 heartbeater.cc:347] Connected to a master server at 127.20.81.62:35849
I20260808 14:36:13.201362 30101 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:13.201495 30101 heartbeater.cc:511] Master 127.20.81.62:35849 requested a full tablet report, sending...
I20260808 14:36:13.201894 29613 ts_manager.cc:194] Registered new tserver with Master: fe1d4e88350d4a19b024ae1c5d671057 (127.20.81.3:35021)
I20260808 14:36:13.202265 29613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:51983
I20260808 14:36:13.207877 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab.
Entry for principal oryx/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab.
WARNING: no policy specified for oryx/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab.
Entry for principal oryx/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab.
WARNING: no policy specified for oryx/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab.
Entry for principal oryx/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab.
I20260808 14:36:13.283989 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 29680
I20260808 14:36:13.292768 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 29823
I20260808 14:36:13.299021 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 29966
I20260808 14:36:13.304059 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 29581
I20260808 14:36:13.310389 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35849
--webserver_interface=127.20.81.62
--webserver_port=34775
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:35849
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:13.395083 30110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:13.395318 30110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:13.395356 30110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:13.396476 30110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:13.396550 30110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:13.396610 30110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:13.396641 30110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:13.396661 30110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:13.398134 30110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:35849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=34775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:13.398406 30110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:13.398633 30110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:13.403574 30118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.403592 30116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.403614 30115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:13.403861 30110 server_base.cc:1034] running on GCE node
I20260808 14:36:13.404090 30110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:13.404366 30110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:13.405527 30110 hybrid_clock.cc:648] HybridClock initialized: now 1786199773405511 us; error 38 us; skew 500 ppm
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199773, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:13.407891 30110 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:36:13.408360 30110 webserver.cc:460] Webserver started at http://127.20.81.62:34775/ using document root <none> and password file <none>
I20260808 14:36:13.408649 30110 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:13.408735 30110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:13.410142 30110 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:13.410789 30127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.410952 30110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:13.411052 30110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "d88e15f808a4483ba85e39fcad1367aa"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "d85bd0fda87816c12bcf2e850870c524"
server_key_iv: "acae53ec4e9825161e64e68b4c321dfb"
server_key_version: "encryptionkey@0"
I20260808 14:36:13.411396 30110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:13.424233 30110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:13.426167 30110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:13.426319 30110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:13.430474 30110 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:35849
I20260808 14:36:13.430505 30184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:35849 every 8 connection(s)
I20260808 14:36:13.430886 30110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:13.432320 30185 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:36:13.433096 30185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: Bootstrap starting.
I20260808 14:36:13.435425 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 30110
I20260808 14:36:13.435843 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:46281
--local_ip_for_outbound_sockets=127.20.81.1
--tserver_master_addrs=127.20.81.62:35849
--webserver_port=45389
--webserver_interface=127.20.81.1
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.81.1
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:13.442255 30185 log.cc:824] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:13.443974 30185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:36:13.444283 30185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: Bootstrap complete.
I20260808 14:36:13.446683 30185 raft_consensus.cc:348] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } }
I20260808 14:36:13.446906 30185 raft_consensus.cc:729] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d88e15f808a4483ba85e39fcad1367aa, State: Initialized, Role: FOLLOWER
I20260808 14:36:13.447072 30185 consensus_queue.cc:260] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } }
I20260808 14:36:13.447149 30185 raft_consensus.cc:388] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:13.447216 30185 raft_consensus.cc:482] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:13.447257 30185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:36:13.448275 30185 raft_consensus.cc:504] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } }
I20260808 14:36:13.448364 30185 leader_election.cc:302] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d88e15f808a4483ba85e39fcad1367aa; no voters:
I20260808 14:36:13.448597 30185 leader_election.cc:288] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:36:13.448643 30189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:36:13.448769 30189 raft_consensus.cc:686] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [term 2 LEADER]: Becoming Leader. State: Replica: d88e15f808a4483ba85e39fcad1367aa, State: Running, Role: LEADER
I20260808 14:36:13.448858 30189 consensus_queue.cc:237] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } }
I20260808 14:36:13.448887 30185 sys_catalog.cc:564] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:13.449626 30190 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d88e15f808a4483ba85e39fcad1367aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } } }
I20260808 14:36:13.449729 30190 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:13.449903 30191 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader d88e15f808a4483ba85e39fcad1367aa. Latest consensus state: current_term: 2 leader_uuid: "d88e15f808a4483ba85e39fcad1367aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88e15f808a4483ba85e39fcad1367aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35849 } } }
I20260808 14:36:13.449972 30191 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:13.450080 30199 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:13.450580 30199 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:13.450709 30199 catalog_manager.cc:1259] Loaded cluster ID: 130a415d37f1444bb781b204ed9e537b
I20260808 14:36:13.450995 30199 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:13.452234 30199 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:13.452452 30199 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d88e15f808a4483ba85e39fcad1367aa: Loaded TSK: 0
I20260808 14:36:13.452749 30199 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:36:13.521463 30187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:13.521673 30187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:13.521697 30187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:13.522877 30187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:13.522918 30187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:13.522944 30187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:36:13.524379 30187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.1.keytab
--principal=oryx/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:46281
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=45389
--tserver_master_addrs=127.20.81.62:35849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:13.524684 30187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:13.524923 30187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:13.529811 30213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.529863 30214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.529837 30216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:13.530180 30187 server_base.cc:1034] running on GCE node
I20260808 14:36:13.530392 30187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:13.530625 30187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:13.531790 30187 hybrid_clock.cc:648] HybridClock initialized: now 1786199773531776 us; error 32 us; skew 500 ppm
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199773, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:13.538259 30187 init.cc:377] Logged in from keytab as oryx/127.20.81.1@KRBTEST.COM (short username oryx)
I20260808 14:36:13.538793 30187 webserver.cc:460] Webserver started at http://127.20.81.1:45389/ using document root <none> and password file <none>
I20260808 14:36:13.539036 30187 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:13.539122 30187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:13.540519 30187 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:36:13.541247 30223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.541441 30187 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:13.541535 30187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "5fb76dada39540ed932edfeaa6a85f63"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "0d1677cc7eab5278bb86f897f3fe4d8a"
server_key_iv: "524318a14a6a26d5fce314c34d157416"
server_key_version: "encryptionkey@0"
I20260808 14:36:13.541917 30187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:13.552764 30187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:13.554927 30187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:13.555095 30187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:13.555333 30187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:13.555647 30187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:13.555704 30187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.555747 30187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:13.555774 30187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.562260 30187 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:46281
I20260808 14:36:13.562332 30344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:46281 every 8 connection(s)
I20260808 14:36:13.562696 30187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:13.571759 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 30187
I20260808 14:36:13.572090 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:38109
--local_ip_for_outbound_sockets=127.20.81.2
--tserver_master_addrs=127.20.81.62:35849
--webserver_port=37067
--webserver_interface=127.20.81.2
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.81.2
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:13.577531 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.563468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:55337)
0808 14:36:13.563645 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.563689 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.564167 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.569244 (+ 5077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.569248 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.569841 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.570030 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.570035 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.571683 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.571684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.573060 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.573064 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.573863 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.573864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.574015 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.574675 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.574687 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.577316 (+ 2629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
W20260808 14:36:13.577768 30345 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:35849 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.81.62:35849: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
W20260808 14:36:13.578053 30348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:13.563541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:55337 (local address 127.20.81.62:35849)
0808 14:36:13.568725 (+ 5184us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.568737 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.568795 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:36:13.568935 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.568954 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.569029 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.569194 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.570168 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.571559 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.573159 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.573760 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.573867 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.577480 (+ 3613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:55337: BlockingRecv error: recv got EOF from 127.20.81.1:55337 (error 108)
Metrics: {"server-negotiator.queue_time_us":5112,"thread_start_us":88,"threads_started":1}
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:13.582880 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.577977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:53103)
0808 14:36:13.578303 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.578315 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.578358 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.578649 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.578651 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.578778 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.578820 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.578821 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.579790 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.579791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.580276 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.580277 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.580796 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.580796 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.580847 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.581277 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.581282 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.582834 (+ 1552us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":82,"threads_started":1}
W20260808 14:36:13.583043 30348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:13.578166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:53103 (local address 127.20.81.62:35849)
0808 14:36:13.578505 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.578508 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.578518 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:13.578543 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.578545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.578559 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.578629 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.578901 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.579699 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.580356 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.580718 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.580800 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.582953 (+ 2153us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:53103: BlockingRecv error: recv got EOF from 127.20.81.1:53103 (error 108)
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":76,"threads_started":1}
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:13.587622 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.583184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:54803)
0808 14:36:13.583228 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.583237 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.583269 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.583412 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.583412 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.583516 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.583541 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.583542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.584470 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.584471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.584979 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.584981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.585423 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.585424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.585459 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.585850 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.585854 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.587559 (+ 1705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 14:36:13.587702 30348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:13.583243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:54803 (local address 127.20.81.62:35849)
0808 14:36:13.583277 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.583280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.583288 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:36:13.583316 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.583317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.583327 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.583394 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.583619 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.584392 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.585052 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.585352 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.585420 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.587633 (+ 2213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:54803: BlockingRecv error: recv got EOF from 127.20.81.1:54803 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 14:36:13.587764 30345 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:36:13.658823 30349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:13.659024 30349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:13.659046 30349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:13.660673 30349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:13.660725 30349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:13.660763 30349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:36:13.662273 30349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.2.keytab
--principal=oryx/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:38109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=37067
--tserver_master_addrs=127.20.81.62:35849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:13.662554 30349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:13.662787 30349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:13.667755 30357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.667762 30358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.667799 30360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:13.668008 30349 server_base.cc:1034] running on GCE node
I20260808 14:36:13.668289 30349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:13.668619 30349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:13.669799 30349 hybrid_clock.cc:648] HybridClock initialized: now 1786199773669796 us; error 38 us; skew 500 ppm
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199773, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:13.672224 30349 init.cc:377] Logged in from keytab as oryx/127.20.81.2@KRBTEST.COM (short username oryx)
I20260808 14:36:13.672793 30349 webserver.cc:460] Webserver started at http://127.20.81.2:37067/ using document root <none> and password file <none>
I20260808 14:36:13.673041 30349 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:13.673125 30349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:13.674520 30349 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:13.675161 30369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.675343 30349 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:36:13.675444 30349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "4a59ee8f07da4348b67f7b1a5e912d54"
format_stamp: "Formatted at 2026-08-08 14:36:12 on dist-test-slave-8n49"
server_key: "179ed4995ac303e5bfbe44c0a22ff472"
server_key_iv: "a6bc8db74ad8b8f5f044ba8bb5bdf707"
server_key_version: "encryptionkey@0"
I20260808 14:36:13.675805 30349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:13.689419 30349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:13.691391 30349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:13.691555 30349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:13.691792 30349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:13.692106 30349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:13.692162 30349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.692203 30349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:13.692232 30349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.698638 30349 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:38109
I20260808 14:36:13.698683 30486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:38109 every 8 connection(s)
I20260808 14:36:13.699059 30349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:13.706192 30489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.699799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:39751)
0808 14:36:13.699962 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.699998 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.700472 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.700730 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.700733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.701290 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.701479 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.701484 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.702142 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.702143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.702931 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.702933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.703253 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.703254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.703352 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.703805 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.703813 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.706044 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":100,"threads_started":1}
W20260808 14:36:13.706244 30348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:13.699841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:39751 (local address 127.20.81.62:35849)
0808 14:36:13.699941 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.699943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.700096 (+ 153us) server_negotiation.cc:407] Connection header received
0808 14:36:13.700596 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.700597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.700620 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.700673 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.701563 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.702059 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.703003 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.703181 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.703231 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.706197 (+ 2966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:39751: BlockingRecv error: recv got EOF from 127.20.81.2:39751 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 14:36:13.706516 30487 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:35849 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.81.62:35849: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
I20260808 14:36:13.708732 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 30349
I20260808 14:36:13.709074 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:35021
--local_ip_for_outbound_sockets=127.20.81.3
--tserver_master_addrs=127.20.81.62:35849
--webserver_port=42853
--webserver_interface=127.20.81.3
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.81.3
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:13.711407 30489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.706772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:36691)
0808 14:36:13.706827 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.706840 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.706887 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.707007 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.707007 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.707118 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.707162 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.707164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.707751 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.707752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.708238 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.708239 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.708710 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.708711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.708793 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.709312 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.709318 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.711318 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 14:36:13.711469 30348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:13.706834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:36691 (local address 127.20.81.62:35849)
0808 14:36:13.706892 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.706894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.706902 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:36:13.706942 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.706943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.706952 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.706990 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.707223 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.707679 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.708349 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.708535 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.708710 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.711405 (+ 2695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:36691: BlockingRecv error: recv got EOF from 127.20.81.2:36691 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:13.716084 30489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.711780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:41453)
0808 14:36:13.711831 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.711841 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.711904 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.712044 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.712045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.712174 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.712200 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.712201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.712885 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.712886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.713541 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.713543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.713894 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.713895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.713947 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.714378 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.714382 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.716004 (+ 1622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:36:13.716131 30348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:13.711851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:41453 (local address 127.20.81.62:35849)
0808 14:36:13.711908 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.711910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.711919 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:13.711963 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.711964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.711972 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.712040 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.712275 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.712808 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.713637 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.713821 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.713896 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.716071 (+ 2175us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:41453: BlockingRecv error: recv got EOF from 127.20.81.2:41453 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 14:36:13.716325 30487 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:36:13.793584 30490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:13.793824 30490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:13.793864 30490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:13.795109 30490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:13.795172 30490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:13.795219 30490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:36:13.796710 30490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/krb5kdc/oryx_127.20.81.3.keytab
--principal=oryx/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:35021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=42853
--tserver_master_addrs=127.20.81.62:35849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:13.796985 30490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:13.797219 30490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:13.802145 30496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.802142 30498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:13.802106 30495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:13.802373 30490 server_base.cc:1034] running on GCE node
I20260808 14:36:13.802568 30490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:13.802814 30490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:13.803978 30490 hybrid_clock.cc:648] HybridClock initialized: now 1786199773803971 us; error 37 us; skew 500 ppm
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199773, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:13.806480 30490 init.cc:377] Logged in from keytab as oryx/127.20.81.3@KRBTEST.COM (short username oryx)
I20260808 14:36:13.806897 30490 webserver.cc:460] Webserver started at http://127.20.81.3:42853/ using document root <none> and password file <none>
I20260808 14:36:13.807137 30490 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:13.807221 30490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:13.808616 30490 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:36:13.809211 30508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.809379 30490 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:13.809480 30490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "fe1d4e88350d4a19b024ae1c5d671057"
format_stamp: "Formatted at 2026-08-08 14:36:13 on dist-test-slave-8n49"
server_key: "551c9c4b0502b062e5c4cf953c198968"
server_key_iv: "8a625bd7241c72548d7333b337269822"
server_key_version: "encryptionkey@0"
I20260808 14:36:13.809818 30490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:13.823349 30490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:13.825233 30490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:13.825393 30490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:13.825604 30490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:13.825906 30490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:13.825973 30490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.826013 30490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:13.826042 30490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:13.831597 30490 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:35021
I20260808 14:36:13.831676 30624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:35021 every 8 connection(s)
I20260808 14:36:13.832013 30490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:13.835330 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 30490
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:13.839619 30627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.832769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:43965)
0808 14:36:13.832912 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.832946 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.833397 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.833599 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.833602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.834145 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.834324 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.834329 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.834954 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.834955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.836116 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.836119 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.836647 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.836648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.836759 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.837282 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.837290 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.839475 (+ 2185us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
W20260808 14:36:13.839679 30348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:13.832788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:43965 (local address 127.20.81.62:35849)
0808 14:36:13.832840 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.832841 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.833027 (+ 186us) server_negotiation.cc:407] Connection header received
0808 14:36:13.833483 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.833484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.833494 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.833547 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.834397 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.834876 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.836176 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.836496 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.836640 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.839607 (+ 2967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:43965: BlockingRecv error: recv got EOF from 127.20.81.3:43965 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 14:36:13.839931 30625 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:35849 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.81.62:35849: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
I20260808 14:36:13.843686 30351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.835861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37376 (local address 127.20.81.62:35849)
0808 14:36:13.835928 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.835930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.835940 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:13.836016 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.836017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.836030 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.836117 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.836886 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.837364 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.838354 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.838613 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.838687 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.840297 (+ 1610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:13.840302 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:13.840302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:13.840316 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:13.842128 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:13.842524 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:13.842539 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:13.842540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:13.842669 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:13.842897 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:13.842898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:13.842898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:13.843194 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:13.843293 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:13.843467 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 14:36:13.843557 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:13.845180 30627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.840221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:40781)
0808 14:36:13.840274 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.840289 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.840346 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.840609 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.840610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.840765 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.840820 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.840822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.841720 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.841721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.842263 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.842266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.842635 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.842636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.842690 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.843102 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.843106 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.845112 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 14:36:13.845266 30348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:13.840384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:40781 (local address 127.20.81.62:35849)
0808 14:36:13.840440 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.840442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.840454 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:36:13.840475 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.840476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.840485 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.840577 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.840903 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.841632 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.842347 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.842559 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.842626 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.845208 (+ 2582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:40781: BlockingRecv error: recv got EOF from 127.20.81.3:40781 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:13 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:13.849159 30627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:13.845449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:52495)
0808 14:36:13.845517 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:13.845528 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:13.845569 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:13.845675 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:13.845675 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:13.845781 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:13.845807 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.845808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.846348 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.846348 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.846835 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:13.846837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.847144 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.847145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:13.847181 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.847491 (+ 310us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:13.847495 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:13.849119 (+ 1624us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:36:13.849290 30348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:13.845525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:52495 (local address 127.20.81.62:35849)
0808 14:36:13.845573 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:13.845574 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:13.845581 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:13.845618 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:13.845619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:13.845626 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:13.845671 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:13.845851 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.846278 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.846910 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:13.847082 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:13.847130 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:13.849230 (+ 2100us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:52495: BlockingRecv error: recv got EOF from 127.20.81.3:52495 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 14:36:13.849329 30625 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 14:36:14 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:14 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:14.592717 30630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:14.588102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:58323)
0808 14:36:14.588233 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:14.588245 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:14.588304 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:14.588582 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:14.588583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:14.588748 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:14.588799 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:14.588800 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.589466 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.589466 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:14.590006 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:14.590008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.590348 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.590348 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:14.590393 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:14.590822 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:14.590827 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:14.592647 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
W20260808 14:36:14.592845 30631 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:14.588292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:58323 (local address 127.20.81.62:35849)
0808 14:36:14.588441 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:14.588443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:14.588450 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:14.588474 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:14.588474 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:14.588484 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:14.588582 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:14.588866 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.589379 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.590089 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.590283 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.590334 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:14.592740 (+ 2406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:58323: BlockingRecv error: recv got EOF from 127.20.81.1:58323 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":87,"threads_started":1}
Aug 08 14:36:14 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:14 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:14.721485 30632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:14.716724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:46857)
0808 14:36:14.716906 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:14.716918 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:14.716987 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:14.717137 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:14.717138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:14.717332 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:14.717379 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:14.717380 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.718130 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.718136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:14.718680 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:14.718681 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.719043 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.719044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:14.719087 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:14.719517 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:14.719522 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:14.721408 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":102,"threads_started":1}
W20260808 14:36:14.721639 30631 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:14.716817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:46857 (local address 127.20.81.62:35849)
0808 14:36:14.716897 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:14.716899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:14.716968 (+ 69us) server_negotiation.cc:407] Connection header received
0808 14:36:14.717044 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:14.717045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:14.717060 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:14.717131 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:14.717464 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.718031 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.718763 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.718966 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.719031 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:14.721541 (+ 2510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:46857: BlockingRecv error: recv got EOF from 127.20.81.2:46857 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 14:36:14 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:14 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:14.854835 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:14.849748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:51205)
0808 14:36:14.849944 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:14.849959 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:14.850042 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:14.850221 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:14.850223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:14.850415 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:14.850494 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:14.850496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.851260 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.851261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:14.851814 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:14.851815 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.852222 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.852223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:14.852285 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:14.852774 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:14.852779 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:14.854760 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":113,"threads_started":1}
W20260808 14:36:14.854965 30631 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:14.849884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:51205 (local address 127.20.81.62:35849)
0808 14:36:14.849978 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:14.849981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:14.850017 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:36:14.850122 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:14.850123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:14.850136 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:14.850214 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:14.850573 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.851165 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.851937 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:14.852143 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:14.852225 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:14.854889 (+ 2664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:51205: BlockingRecv error: recv got EOF from 127.20.81.3:51205 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 14:36:15 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:15 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:15.597960 30635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:15.593196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:60439)
0808 14:36:15.593397 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:15.593410 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:15.593481 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:15.593621 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:15.593622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:15.593794 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:15.593845 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:15.593846 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.594511 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.594512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:15.595049 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:15.595051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.595418 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.595419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:15.595469 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:15.595940 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:15.595944 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:15.597900 (+ 1956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":100,"threads_started":1}
W20260808 14:36:15.598158 30636 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:15.593292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:60439 (local address 127.20.81.62:35849)
0808 14:36:15.593413 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:15.593415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:15.593476 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:36:15.593527 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:15.593528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:15.593539 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:15.593597 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:15.593927 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.594440 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.595136 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.595334 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.595406 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:15.598065 (+ 2659us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:60439: BlockingRecv error: recv got EOF from 127.20.81.1:60439 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":72,"threads_started":1}
Aug 08 14:36:15 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:15 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:15.726630 30637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:15.721999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:53707)
0808 14:36:15.722142 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:15.722152 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:15.722210 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:15.722329 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:15.722330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:15.722498 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:15.722548 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:15.722550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.723215 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.723216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:15.723772 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:15.723775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.724130 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.724131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:15.724192 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:15.724765 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:15.724770 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:15.726560 (+ 1790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":84,"threads_started":1}
W20260808 14:36:15.726735 30636 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:15.722050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:53707 (local address 127.20.81.62:35849)
0808 14:36:15.722115 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:15.722117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:15.722208 (+ 91us) server_negotiation.cc:407] Connection header received
0808 14:36:15.722262 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:15.722262 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:15.722273 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:15.722324 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:15.722608 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.723130 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.723850 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.724045 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.724101 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:15.726646 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:53707: BlockingRecv error: recv got EOF from 127.20.81.2:53707 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 14:36:15 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:15 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:15.860463 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:15.855550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:45063)
0808 14:36:15.855707 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:15.855718 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:15.855797 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:15.856029 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:15.856030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:15.856223 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:15.856274 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:15.856275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.857035 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.857036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:15.857585 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:15.857587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.857969 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.857970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:15.858039 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:15.858511 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:15.858516 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:15.860343 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
W20260808 14:36:15.860487 30636 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:15.855721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:45063 (local address 127.20.81.62:35849)
0808 14:36:15.855803 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:15.855805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:15.855815 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:15.855866 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:15.855867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:15.855882 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:15.856013 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:15.856363 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.856943 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.857677 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:15.857880 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:15.857973 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:15.860423 (+ 2450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:45063: BlockingRecv error: recv got EOF from 127.20.81.3:45063 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 14:36:16 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:16 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:16.603217 30639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:16.598430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:60407)
0808 14:36:16.598612 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:16.598625 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:16.598680 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:16.598827 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:16.598828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:16.599008 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:16.599060 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:16.599062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.599745 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.599746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:16.600327 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:16.600329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.600736 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.600738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:16.600792 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:16.601267 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:16.601273 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:16.603148 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
W20260808 14:36:16.603405 30640 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:16.598522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:60407 (local address 127.20.81.62:35849)
0808 14:36:16.598665 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:16.598667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:16.598677 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:16.598741 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:16.598742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:16.598753 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:16.598803 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:16.599136 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.599662 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.600426 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.600657 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.600720 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:16.603315 (+ 2595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:60407: BlockingRecv error: recv got EOF from 127.20.81.1:60407 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
Aug 08 14:36:16 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:16 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:16.732033 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:16.727138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:56975)
0808 14:36:16.727292 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:16.727305 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:16.727379 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:16.727594 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:16.727595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:16.727855 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:16.727918 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:16.727922 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.728630 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.728631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:16.729166 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:16.729167 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.729525 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.729526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:16.729571 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:16.729994 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:16.729998 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:16.731952 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
W20260808 14:36:16.732102 30640 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:16.727241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:56975 (local address 127.20.81.62:35849)
0808 14:36:16.727302 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:16.727304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:16.727384 (+ 80us) server_negotiation.cc:407] Connection header received
0808 14:36:16.727465 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:16.727466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:16.727478 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:16.727557 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:16.728016 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.728535 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.729241 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.729435 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.729514 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:16.732053 (+ 2539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:56975: BlockingRecv error: recv got EOF from 127.20.81.2:56975 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 08 14:36:16 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:16 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:16.865648 30642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:16.860977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:54753)
0808 14:36:16.861154 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:16.861167 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:16.861264 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:16.861423 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:16.861424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:16.861613 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:16.861663 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:16.861665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.862356 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.862357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:16.862879 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:16.862881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.863271 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.863272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:16.863340 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:16.863788 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:16.863792 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:16.865586 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
W20260808 14:36:16.865749 30640 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:16.861076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:54753 (local address 127.20.81.62:35849)
0808 14:36:16.861158 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:16.861160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:16.861243 (+ 83us) server_negotiation.cc:407] Connection header received
0808 14:36:16.861342 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:16.861343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:16.861358 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:16.861406 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:16.861748 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.862260 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.862968 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:16.863181 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:16.863269 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:16.865681 (+ 2412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:54753: BlockingRecv error: recv got EOF from 127.20.81.3:54753 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 14:36:17 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:17 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:17.608397 30643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:17.603735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:36483)
0808 14:36:17.603881 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:17.603903 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:17.603953 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:17.604108 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:17.604109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:17.604268 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:17.604321 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:17.604322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.605062 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.605064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:17.605610 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:17.605612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.605971 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.605972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:17.606019 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:17.606455 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:17.606460 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:17.608335 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
W20260808 14:36:17.608521 30644 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:17.603805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:36483 (local address 127.20.81.62:35849)
0808 14:36:17.603968 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:17.603970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:17.603991 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:36:17.604016 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:17.604017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:17.604027 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:17.604095 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:17.604387 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.604960 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.605701 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.605896 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.605962 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:17.608437 (+ 2475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:36483: BlockingRecv error: recv got EOF from 127.20.81.1:36483 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":106,"threads_started":1}
Aug 08 14:36:17 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:17 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:17.737363 30645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:17.732631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:49589)
0808 14:36:17.732777 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:17.732788 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:17.732849 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:17.733056 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:17.733057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:17.733217 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:17.733268 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:17.733269 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.733955 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.733956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:17.734503 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:17.734505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.734897 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.734898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:17.734949 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:17.735406 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:17.735411 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:17.737303 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
W20260808 14:36:17.737524 30644 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:17.732651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:49589 (local address 127.20.81.62:35849)
0808 14:36:17.732730 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:17.732732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:17.732873 (+ 141us) server_negotiation.cc:407] Connection header received
0808 14:36:17.732907 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:17.732908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:17.732929 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:17.732999 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:17.733358 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.733864 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.734619 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.734811 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.734878 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:17.737392 (+ 2514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:49589: BlockingRecv error: recv got EOF from 127.20.81.2:49589 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 14:36:17 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:17 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:17.870965 30646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:17.866240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:45603)
0808 14:36:17.866381 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:17.866393 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:17.866466 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:17.866610 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:17.866611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:17.866782 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:17.866837 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:17.866839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.867492 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.867493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:17.868052 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:17.868054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.868411 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.868412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:17.868463 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:17.869008 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:17.869014 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:17.870886 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
W20260808 14:36:17.871026 30644 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:17.866313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:45603 (local address 127.20.81.62:35849)
0808 14:36:17.866402 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:17.866404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:17.866452 (+ 48us) server_negotiation.cc:407] Connection header received
0808 14:36:17.866528 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:17.866529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:17.866542 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:17.866592 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:17.866903 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.867407 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.868144 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:17.868330 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:17.868386 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:17.870978 (+ 2592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:45603: BlockingRecv error: recv got EOF from 127.20.81.3:45603 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 14:36:18 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:18 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:18.616434 30647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:18.608929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:43003)
0808 14:36:18.609114 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:18.609125 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:18.609182 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:18.609318 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:18.609319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:18.609477 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:18.609542 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:18.609544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.610197 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.610198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:18.610734 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:18.610736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.611054 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.611055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:18.611098 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:18.614574 (+ 3476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:18.614580 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:18.616372 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":119,"threads_started":1}
W20260808 14:36:18.616561 30648 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:18.609005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:43003 (local address 127.20.81.62:35849)
0808 14:36:18.609123 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:18.609125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:18.609174 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:36:18.609240 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:18.609241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:18.609251 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:18.609300 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:18.609606 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.610133 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.610802 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.610987 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.611042 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:18.616471 (+ 5429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:43003: BlockingRecv error: recv got EOF from 127.20.81.1:43003 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":52,"threads_started":1}
Aug 08 14:36:18 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:18 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:18.742316 30649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:18.737833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:47181)
0808 14:36:18.737983 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:18.738026 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:18.738084 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:18.738217 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:18.738218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:18.738381 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:18.738434 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:18.738435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.739069 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.739070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:18.739593 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:18.739595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.739916 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.739917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:18.739970 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:18.740407 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:18.740411 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:18.742218 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
W20260808 14:36:18.742367 30648 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:18.737942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:47181 (local address 127.20.81.62:35849)
0808 14:36:18.737987 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:18.737991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:18.738086 (+ 95us) server_negotiation.cc:407] Connection header received
0808 14:36:18.738133 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:18.738134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:18.738145 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:18.738195 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:18.738493 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.738997 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.739670 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.739853 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.739902 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:18.742302 (+ 2400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:47181: BlockingRecv error: recv got EOF from 127.20.81.2:47181 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 08 14:36:18 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:18 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:18.876278 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:18.871514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:45945)
0808 14:36:18.871665 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:18.871675 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:18.871733 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:18.871878 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:18.871879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:18.872141 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:18.872226 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:18.872229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.873114 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.873116 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:18.873646 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:18.873648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.873980 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.873981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:18.874025 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:18.874472 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:18.874477 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:18.876219 (+ 1742us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
W20260808 14:36:18.876361 30648 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:18.871594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:45945 (local address 127.20.81.62:35849)
0808 14:36:18.871654 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:18.871656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:18.871719 (+ 63us) server_negotiation.cc:407] Connection header received
0808 14:36:18.871796 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:18.871797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:18.871809 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:18.871853 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:18.872327 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.873042 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.873726 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:18.873908 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:18.873968 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:18.876311 (+ 2343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:45945: BlockingRecv error: recv got EOF from 127.20.81.3:45945 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 14:36:19 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:19 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:19.622155 30651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:19.616981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:45669)
0808 14:36:19.617134 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:19.617144 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:19.617207 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:19.617355 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:19.617356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:19.617526 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:19.617576 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:19.617578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.618346 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.618347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:19.618982 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:19.618985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.619396 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.619398 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:19.619463 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:19.620100 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:19.620106 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:19.622093 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
W20260808 14:36:19.622336 30652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:19.617024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:45669 (local address 127.20.81.62:35849)
0808 14:36:19.617145 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:19.617147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:19.617208 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:36:19.617258 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:19.617258 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:19.617271 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:19.617339 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:19.617673 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.618248 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.619078 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.619299 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.619376 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:19.622228 (+ 2852us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:45669: BlockingRecv error: recv got EOF from 127.20.81.1:45669 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
Aug 08 14:36:19 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:19 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:19.747540 30653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:19.742821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:42971)
0808 14:36:19.742977 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:19.742988 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:19.743052 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:19.743186 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:19.743187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:19.743351 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:19.743400 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:19.743402 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.744087 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.744088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:19.744719 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:19.744722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.745064 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.745066 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:19.745144 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:19.745630 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:19.745634 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:19.747476 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
W20260808 14:36:19.747658 30652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:19.742911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:42971 (local address 127.20.81.62:35849)
0808 14:36:19.742976 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:19.742978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:19.743052 (+ 74us) server_negotiation.cc:407] Connection header received
0808 14:36:19.743099 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:19.743100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:19.743110 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:19.743168 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:19.743463 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.744017 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.744787 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.744974 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.745032 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:19.747582 (+ 2550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:42971: BlockingRecv error: recv got EOF from 127.20.81.2:42971 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 14:36:19 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:19 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:19.881651 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:19.876873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:39083)
0808 14:36:19.877020 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:19.877039 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:19.877097 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:19.877236 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:19.877237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:19.877400 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:19.877452 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:19.877454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.878201 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.878202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:19.878846 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:19.878849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.879213 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.879213 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:19.879257 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:19.879769 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:19.879775 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:19.881592 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
W20260808 14:36:19.881814 30652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:19.876983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:39083 (local address 127.20.81.62:35849)
0808 14:36:19.877039 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:19.877041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:19.877081 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:36:19.877144 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:19.877144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:19.877157 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:19.877219 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:19.877531 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.878082 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.878924 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.879143 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.879205 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:19.881721 (+ 2516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:39083: BlockingRecv error: recv got EOF from 127.20.81.3:39083 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 08 14:36:20 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:20 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:20.627588 30655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:20.622651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:60937)
0808 14:36:20.622833 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:20.622845 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:20.622908 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:20.623054 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:20.623055 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:20.623262 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:20.623314 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:20.623316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.624124 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.624125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:20.624737 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:20.624739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.625123 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.625124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:20.625191 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:20.625655 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:20.625660 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:20.627485 (+ 1825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":94,"threads_started":1}
W20260808 14:36:20.627641 30656 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:20.622778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:60937 (local address 127.20.81.62:35849)
0808 14:36:20.622919 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:20.622920 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:20.622929 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:20.622958 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:20.622959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:20.622971 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:20.623031 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:20.623423 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.624032 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.624823 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.625033 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.625110 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:20.627567 (+ 2457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:60937: BlockingRecv error: recv got EOF from 127.20.81.1:60937 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":77,"threads_started":1}
Aug 08 14:36:20 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:20 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:20.752957 30657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:20.748115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:55151)
0808 14:36:20.748271 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:20.748281 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:20.748332 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:20.748498 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:20.748499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:20.748680 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:20.748732 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:20.748734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.749492 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.749493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:20.750117 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:20.750119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.750463 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.750464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:20.750520 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:20.750982 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:20.750987 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:20.752845 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
W20260808 14:36:20.752985 30656 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:20.748201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:55151 (local address 127.20.81.62:35849)
0808 14:36:20.748298 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:20.748306 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:20.748323 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:36:20.748402 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:20.748403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:20.748417 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:20.748482 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:20.748802 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.749429 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.750195 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.750389 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.750456 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:20.752926 (+ 2470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:55151: BlockingRecv error: recv got EOF from 127.20.81.2:55151 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 14:36:20 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:20 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:20.886920 30658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:20.882251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:57051)
0808 14:36:20.882394 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:20.882405 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:20.882465 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:20.882600 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:20.882601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:20.882782 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:20.882834 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:20.882836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.883471 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.883472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:20.884235 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:20.884239 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.884653 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.884654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:20.884696 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:20.885167 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:20.885172 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:20.886852 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
W20260808 14:36:20.887049 30656 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:20.882302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:57051 (local address 127.20.81.62:35849)
0808 14:36:20.882375 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:20.882377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:20.882471 (+ 94us) server_negotiation.cc:407] Connection header received
0808 14:36:20.882514 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:20.882515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:20.882528 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:20.882583 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:20.882900 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.883406 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.884317 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.884543 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.884659 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:20.886945 (+ 2286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:57051: BlockingRecv error: recv got EOF from 127.20.81.3:57051 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 14:36:21 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:21 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:21.633487 30659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:21.628181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:37761)
0808 14:36:21.628359 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:21.628375 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:21.628447 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:21.628681 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:21.628682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:21.628854 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:21.628905 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.628907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.629639 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.629641 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.630181 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.630183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.630603 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.630605 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.630653 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.631218 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:21.631225 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:21.633388 (+ 2163us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
W20260808 14:36:21.633563 30660 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:21.628333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:37761 (local address 127.20.81.62:35849)
0808 14:36:21.628502 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:21.628504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:21.628512 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:36:21.628539 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:21.628540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:21.628568 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:21.628632 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:21.629011 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.629546 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.630277 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.630520 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.630584 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.633487 (+ 2903us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:37761: BlockingRecv error: recv got EOF from 127.20.81.1:37761 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":98,"threads_started":1}
Aug 08 14:36:21 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:21 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:21.758332 30661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:21.753498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:51931)
0808 14:36:21.753651 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:21.753661 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:21.753720 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:21.753859 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:21.753860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:21.754045 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:21.754100 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.754102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.754929 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.754930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.755482 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.755484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.755838 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.755839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.755880 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.756347 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:21.756352 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:21.758270 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
W20260808 14:36:21.758492 30660 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:21.753570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:51931 (local address 127.20.81.62:35849)
0808 14:36:21.753643 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:21.753646 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:21.753702 (+ 56us) server_negotiation.cc:407] Connection header received
0808 14:36:21.753768 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:21.753769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:21.753779 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:21.753832 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:21.754169 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.754811 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.755570 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.755766 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.755825 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.758392 (+ 2567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:51931: BlockingRecv error: recv got EOF from 127.20.81.2:51931 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 14:36:21 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:21 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:21.892424 30662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:21.887410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:56341)
0808 14:36:21.887709 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:21.887721 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:21.887793 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:21.887946 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:21.887947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:21.888142 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:21.888192 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.888194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.888946 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.888948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.889491 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.889493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.889858 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.889859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.889918 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.890417 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:21.890422 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:21.892310 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":219,"threads_started":1}
W20260808 14:36:21.892480 30660 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:21.887619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:56341 (local address 127.20.81.62:35849)
0808 14:36:21.887699 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:21.887701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:21.887772 (+ 71us) server_negotiation.cc:407] Connection header received
0808 14:36:21.887851 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:21.887852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:21.887866 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:21.887939 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:21.888279 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.888856 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.889588 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.889782 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.889860 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.892413 (+ 2553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:56341: BlockingRecv error: recv got EOF from 127.20.81.3:56341 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 14:36:22 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:22 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:22.639086 30663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.634060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:35919)
0808 14:36:22.634198 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:22.634211 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:22.634278 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:22.634548 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:22.634550 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:22.634735 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:22.634786 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.634787 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.635474 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.635475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.636008 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.636009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.636359 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.636359 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.636402 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.636977 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:22.636983 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:22.639018 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
W20260808 14:36:22.639201 30664 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:22.634125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:35919 (local address 127.20.81.62:35849)
0808 14:36:22.634271 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:22.634273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:22.634286 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:36:22.634384 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:22.634385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:22.634398 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:22.634498 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:22.634863 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.635383 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.636092 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.636292 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.636345 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.639122 (+ 2777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:35919: BlockingRecv error: recv got EOF from 127.20.81.1:35919 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":64,"threads_started":1}
Aug 08 14:36:22 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:22 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:22.763842 30665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.758894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:44629)
0808 14:36:22.759078 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:22.759091 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:22.759164 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:22.759323 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:22.759324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:22.759521 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:22.759573 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.759575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.760266 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.760267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.760823 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.760825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.761213 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.761214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.761277 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.761816 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:22.761824 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:22.763728 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":91,"threads_started":1}
W20260808 14:36:22.763892 30664 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:22.758985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:44629 (local address 127.20.81.62:35849)
0808 14:36:22.759072 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:22.759075 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:22.759141 (+ 66us) server_negotiation.cc:407] Connection header received
0808 14:36:22.759222 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:22.759222 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:22.759236 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:22.759316 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:22.759664 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.760178 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.760919 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.761121 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.761212 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.763823 (+ 2611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:44629: BlockingRecv error: recv got EOF from 127.20.81.2:44629 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 14:36:22 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:22 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:22.897456 30666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.892970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:47123)
0808 14:36:22.893154 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:22.893165 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:22.893230 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:22.893365 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:22.893366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:22.893544 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:22.893597 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.893598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.894228 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.894229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.894786 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.894789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.895117 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.895118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.895169 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.895623 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:22.895627 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:22.897396 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":116,"threads_started":1}
W20260808 14:36:22.897607 30664 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:22.893031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:47123 (local address 127.20.81.62:35849)
0808 14:36:22.893110 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:22.893113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:22.893213 (+ 100us) server_negotiation.cc:407] Connection header received
0808 14:36:22.893279 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:22.893280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:22.893294 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:22.893343 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:22.893664 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.894161 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.894866 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.895050 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.895102 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.897516 (+ 2414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:47123: BlockingRecv error: recv got EOF from 127.20.81.3:47123 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 14:36:23 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:23 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:23.648021 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.639688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:45871)
0808 14:36:23.639860 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:23.639872 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:23.639959 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:23.640157 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:23.640159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:23.640334 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:23.640385 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.640386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.641100 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.641101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.641647 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.641649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.641976 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.641977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.642016 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.645877 (+ 3861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:23.645883 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:23.647957 (+ 2074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":111,"threads_started":1}
W20260808 14:36:23.648123 30668 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:23.639749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:45871 (local address 127.20.81.62:35849)
0808 14:36:23.639893 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:23.639895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:23.639936 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:36:23.640023 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:23.640023 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:23.640034 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:23.640098 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:23.640492 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.641026 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.641723 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.641910 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.641963 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.648067 (+ 6104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:45871: BlockingRecv error: recv got EOF from 127.20.81.1:45871 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":86,"threads_started":1}
Aug 08 14:36:23 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:23 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:23.769402 30669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.764449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:42841)
0808 14:36:23.764667 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:23.764678 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:23.764735 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:23.764878 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:23.764879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:23.765058 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:23.765110 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.765112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.765773 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.765774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.766303 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.766305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.766689 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.766691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.766744 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.767306 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:23.767311 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:23.769340 (+ 2029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":121,"threads_started":1}
W20260808 14:36:23.769585 30668 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:23.764582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:42841 (local address 127.20.81.62:35849)
0808 14:36:23.764678 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:23.764680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:23.764733 (+ 53us) server_negotiation.cc:407] Connection header received
0808 14:36:23.764788 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:23.764789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:23.764801 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:23.764857 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:23.765171 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.765682 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.766393 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.766593 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.766652 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.769515 (+ 2863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:42841: BlockingRecv error: recv got EOF from 127.20.81.2:42841 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 14:36:23 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:23 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:23.902482 30670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.897971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:50099)
0808 14:36:23.898191 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:23.898203 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:23.898266 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:23.898433 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:23.898434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:23.898607 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:23.898659 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.898660 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.899323 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.899325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.899852 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.899854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.900224 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.900225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.900266 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.900752 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:23.900757 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:23.902424 (+ 1667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":124,"threads_started":1}
W20260808 14:36:23.902561 30668 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:23.898126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:50099 (local address 127.20.81.62:35849)
0808 14:36:23.898207 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:23.898209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:23.898265 (+ 56us) server_negotiation.cc:407] Connection header received
0808 14:36:23.898324 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:23.898325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:23.898337 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:23.898380 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:23.898722 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.899243 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.899923 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.900149 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.900219 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.902510 (+ 2291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:50099: BlockingRecv error: recv got EOF from 127.20.81.3:50099 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 14:36:24 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:24 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:24.653700 30671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:24.648680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:40301)
0808 14:36:24.648850 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:24.648862 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:24.648919 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:24.649064 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:24.649065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:24.649290 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:24.649338 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.649339 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.650161 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.650162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.650729 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.650731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.651155 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.651156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.651202 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.651665 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:24.651669 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:24.653624 (+ 1955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":95,"threads_started":1}
W20260808 14:36:24.653856 30673 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:24.648775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:40301 (local address 127.20.81.62:35849)
0808 14:36:24.648915 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:24.648918 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:24.648928 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:24.648972 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:24.648973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:24.648984 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:24.649043 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:24.649422 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.650080 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.650832 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.651077 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.651142 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.653748 (+ 2606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:40301: BlockingRecv error: recv got EOF from 127.20.81.1:40301 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":79,"threads_started":1}
Aug 08 14:36:24 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:24 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:24.774572 30674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:24.769961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:59697)
0808 14:36:24.770121 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:24.770133 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:24.770195 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:24.770317 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:24.770318 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:24.770509 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:24.770560 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.770561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.771197 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.771198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.771779 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.771781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.772104 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.772105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.772150 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.772655 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:24.772659 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:24.774448 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
W20260808 14:36:24.774592 30673 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:24.770011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:59697 (local address 127.20.81.62:35849)
0808 14:36:24.770098 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:24.770100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:24.770195 (+ 95us) server_negotiation.cc:407] Connection header received
0808 14:36:24.770248 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:24.770249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:24.770260 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:24.770312 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:24.770623 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.771123 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.771854 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.772036 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.772093 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.774530 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:59697: BlockingRecv error: recv got EOF from 127.20.81.2:59697 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 14:36:24 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:24 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:24.907692 30675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:24.902979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:35899)
0808 14:36:24.903136 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:24.903147 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:24.903205 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:24.903344 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:24.903344 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:24.903512 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:24.903563 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.903565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.904210 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.904211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.904824 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.904827 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.905145 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.905146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.905185 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.905619 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:24.905623 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:24.907630 (+ 2007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
W20260808 14:36:24.907791 30673 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:24.903071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:35899 (local address 127.20.81.62:35849)
0808 14:36:24.903131 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:24.903134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:24.903188 (+ 54us) server_negotiation.cc:407] Connection header received
0808 14:36:24.903251 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:24.903252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:24.903266 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:24.903324 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:24.903630 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.904141 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.904893 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.905081 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.905133 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.907720 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:35899: BlockingRecv error: recv got EOF from 127.20.81.3:35899 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 08 14:36:25 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:25 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:25.658988 30676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:25.654238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:43203)
0808 14:36:25.654409 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:25.654421 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:25.654482 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:25.654618 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:25.654619 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:25.654799 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:25.654850 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:25.654852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.655510 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.655511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:25.656057 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:25.656059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.656386 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.656386 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:25.656440 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:25.656981 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:25.656987 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:25.658912 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
W20260808 14:36:25.659164 30677 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:25.654355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:43203 (local address 127.20.81.62:35849)
0808 14:36:25.654492 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:25.654493 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:25.654503 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:25.654530 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:25.654530 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:25.654541 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:25.654601 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:25.654919 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.655432 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.656133 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.656321 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.656371 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:25.659074 (+ 2703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:43203: BlockingRecv error: recv got EOF from 127.20.81.1:43203 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":78,"threads_started":1}
Aug 08 14:36:25 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:25 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:25.780000 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:25.775177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:48947)
0808 14:36:25.775342 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:25.775359 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:25.775418 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:25.775609 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:25.775610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:25.775799 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:25.775849 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:25.775851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.776525 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.776526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:25.777127 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:25.777129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.777452 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.777453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:25.777495 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:25.777941 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:25.777946 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:25.779929 (+ 1983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
W20260808 14:36:25.780165 30677 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:25.775294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:48947 (local address 127.20.81.62:35849)
0808 14:36:25.775362 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:25.775364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:25.775405 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:36:25.775482 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:25.775483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:25.775494 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:25.775556 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:25.775923 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.776437 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.777199 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.777381 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.777444 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:25.780093 (+ 2649us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:48947: BlockingRecv error: recv got EOF from 127.20.81.2:48947 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 14:36:25 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:25 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:25.913184 30680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:25.908263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:56181)
0808 14:36:25.908462 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:25.908475 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:25.908593 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:25.908765 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:25.908767 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:25.908956 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:25.909011 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:25.909013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.909692 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.909694 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:25.910229 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:25.910231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.910598 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.910599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:25.910660 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:25.911153 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:25.911158 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:25.913069 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":127,"threads_started":1}
W20260808 14:36:25.913228 30677 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:25.908375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:56181 (local address 127.20.81.62:35849)
0808 14:36:25.908456 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:25.908458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:25.908568 (+ 110us) server_negotiation.cc:407] Connection header received
0808 14:36:25.908674 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:25.908675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:25.908693 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:25.908757 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:25.909095 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.909608 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.910316 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:25.910520 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:25.910599 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:25.913160 (+ 2561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:56181: BlockingRecv error: recv got EOF from 127.20.81.3:56181 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 14:36:26 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:26 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:26.664814 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:26.659610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:46549)
0808 14:36:26.659746 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:26.659759 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:26.659828 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:26.660062 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:26.660063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:26.660297 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:26.660349 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:26.660351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.661241 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.661243 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:26.661813 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:26.661815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.662194 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.662195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:26.662248 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:26.662754 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:26.662759 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:26.664698 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
W20260808 14:36:26.664860 30682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:26.659689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:46549 (local address 127.20.81.62:35849)
0808 14:36:26.659852 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:26.659854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:26.659864 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:26.659901 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:26.659902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:26.659913 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:26.660052 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:26.660428 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.661165 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.661899 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.662101 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.662157 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:26.664783 (+ 2626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:46549: BlockingRecv error: recv got EOF from 127.20.81.1:46549 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":102,"threads_started":1}
Aug 08 14:36:26 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:26 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:26.785386 30683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:26.780501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:39555)
0808 14:36:26.780698 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:26.780713 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:26.780786 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:26.780991 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:26.780993 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:26.781257 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:26.781324 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:26.781328 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.782028 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.782029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:26.782552 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:26.782554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.782950 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.782951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:26.783003 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:26.783506 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:26.783512 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:26.785314 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":104,"threads_started":1}
W20260808 14:36:26.785534 30682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:26.780694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:39555 (local address 127.20.81.62:35849)
0808 14:36:26.780770 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:26.780772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:26.780782 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:26.780865 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:26.780866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:26.780880 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:26.780951 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:26.781412 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.781953 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.782663 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.782864 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.782937 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:26.785447 (+ 2510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:39555: BlockingRecv error: recv got EOF from 127.20.81.2:39555 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 14:36:26 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:26 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:26.918557 30684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:26.913731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:52937)
0808 14:36:26.913871 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:26.913883 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:26.913956 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:26.914100 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:26.914100 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:26.914270 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:26.914330 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:26.914332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.915155 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.915156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:26.915713 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:26.915716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.916059 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.916060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:26.916102 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:26.916575 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:26.916580 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:26.918495 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
W20260808 14:36:26.918687 30682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:26.913795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:52937 (local address 127.20.81.62:35849)
0808 14:36:26.913858 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:26.913860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:26.913955 (+ 95us) server_negotiation.cc:407] Connection header received
0808 14:36:26.914020 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:26.914021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:26.914034 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:26.914092 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:26.914430 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.915057 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.915797 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.915990 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.916049 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:26.918598 (+ 2549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:52937: BlockingRecv error: recv got EOF from 127.20.81.3:52937 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 14:36:27 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:27 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:27.669806 30685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.665331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:43267)
0808 14:36:27.665472 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.665486 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.665540 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.665683 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.665684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.665849 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.665900 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.665902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.666554 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.666555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.667104 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.667106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.667435 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.667436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.667476 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.667929 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.667934 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.669745 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
W20260808 14:36:27.669915 30686 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:27.665392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:43267 (local address 127.20.81.62:35849)
0808 14:36:27.665523 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.665525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.665535 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:27.665595 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.665596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.665606 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.665669 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.665963 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.666483 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.667178 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.667369 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.667421 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.669840 (+ 2419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:43267: BlockingRecv error: recv got EOF from 127.20.81.1:43267 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":56,"threads_started":1}
Aug 08 14:36:27 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:27 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:27.790861 30687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.785909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:36631)
0808 14:36:27.786068 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.786081 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.786152 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.786300 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.786301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.786471 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.786521 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.786523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.787239 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.787240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.787764 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.787766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.788204 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.788205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.788248 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.788723 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.788728 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.790751 (+ 2023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
W20260808 14:36:27.790911 30686 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:27.785993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:36631 (local address 127.20.81.62:35849)
0808 14:36:27.786085 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.786087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.786154 (+ 67us) server_negotiation.cc:407] Connection header received
0808 14:36:27.786219 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.786220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.786233 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.786280 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.786592 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.787168 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.787869 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.788123 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.788196 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.790841 (+ 2645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:36631: BlockingRecv error: recv got EOF from 127.20.81.2:36631 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 14:36:27 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:27 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.3@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:27.923872 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.919153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.3:46867)
0808 14:36:27.919323 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.919333 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.919390 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.919537 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.919537 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.919708 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.919757 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.919758 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.920389 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.920390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.921011 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.921014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.921371 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.921373 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.921427 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.921870 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.921875 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.923803 (+ 1928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":111,"threads_started":1}
W20260808 14:36:27.923942 30686 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:27.919236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:46867 (local address 127.20.81.62:35849)
0808 14:36:27.919329 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.919331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.919390 (+ 59us) server_negotiation.cc:407] Connection header received
0808 14:36:27.919455 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.919456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.919471 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.919516 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.919819 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.920320 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.921089 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.921279 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.921340 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.923893 (+ 2553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.3:46867: BlockingRecv error: recv got EOF from 127.20.81.3:46867 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 14:36:28 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:28 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.1@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:28.679785 30690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:28.670355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.1:55409)
0808 14:36:28.670515 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:28.670527 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:28.670577 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:28.670759 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:28.670760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:28.670924 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:28.670977 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:28.670978 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:28.671629 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:28.671629 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:28.672150 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:28.672151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:28.672501 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:28.672502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:28.672544 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:28.677542 (+ 4998us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:28.677549 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:28.679721 (+ 2172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
W20260808 14:36:28.679978 30691 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:28.670490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:55409 (local address 127.20.81.62:35849)
0808 14:36:28.670620 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:28.670622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:28.670631 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:28.670663 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:28.670664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:28.670674 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:28.670741 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:28.671047 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:28.671559 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:28.672223 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:28.672424 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:28.672476 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:28.679909 (+ 7433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.1:55409: BlockingRecv error: recv got EOF from 127.20.81.1:55409 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
Aug 08 14:36:28 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:36:28 dist-test-slave-8n49 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.81.2@KRBTEST.COM for oryx/127.20.81.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:36:28.796056 30692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:28.791439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35849 (local address 127.20.81.2:41297)
0808 14:36:28.791587 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:28.791597 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:28.791657 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:28.791789 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:28.791790 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:28.791946 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:28.791996 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:28.791998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:28.792690 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:28.792691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:28.793231 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:28.793233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:28.793581 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:28.793582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:28.793634 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:28.794132 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:28.794137 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:28.795981 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.81.62:35849: Server oryx/127.20.81.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":72,"threads_started":1}
W20260808 14:36:28.796182 30691 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:28.791526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:41297 (local address 127.20.81.62:35849)
0808 14:36:28.791584 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:28.791586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:28.791644 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:36:28.791713 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:28.791714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:28.791723 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:28.791766 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:28.792068 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:28.792606 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:28.793302 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:28.793492 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:28.793546 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:28.796081 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.81.2:41297: BlockingRecv error: recv got EOF from 127.20.81.2:41297 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:36:28.841312 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 30187
I20260808 14:36:28.849227 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 30349
I20260808 14:36:28.855228 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 30490
I20260808 14:36:28.860527 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 30110
2026-08-08T14:36:28Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17692 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T14:36:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:28Z Disabled control of system clock
I20260808 14:36:28.890630 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:41721
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:38131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:41721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:36:28.972478 30697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:28.972707 30697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:28.972728 30697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:28.973922 30697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:28.973966 30697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:28.973979 30697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:28.974028 30697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:28.974056 30697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:28.975481 30697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:38131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:41721
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:41721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:28.975754 30697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:28.976073 30697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:28.981422 30705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:28.981428 30703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:28.981418 30702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:28.981439 30697 server_base.cc:1034] running on GCE node
I20260808 14:36:28.981904 30697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:28.982213 30697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:28.983382 30697 hybrid_clock.cc:648] HybridClock initialized: now 1786199788983370 us; error 32 us; skew 500 ppm
I20260808 14:36:28.984727 30697 webserver.cc:460] Webserver started at http://127.20.81.62:41093/ using document root <none> and password file <none>
I20260808 14:36:28.984974 30697 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:28.985052 30697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:28.985198 30697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:28.986246 30697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "ac36f26698ac4c598541b3902fbd9919"
format_stamp: "Formatted at 2026-08-08 14:36:28 on dist-test-slave-8n49"
server_key: "18aec23ba6f4991f9d7811bc9807e861"
server_key_iv: "4c40aa93678854efe450889e167ec8df"
server_key_version: "encryptionkey@0"
I20260808 14:36:28.986632 30697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "ac36f26698ac4c598541b3902fbd9919"
format_stamp: "Formatted at 2026-08-08 14:36:28 on dist-test-slave-8n49"
server_key: "18aec23ba6f4991f9d7811bc9807e861"
server_key_iv: "4c40aa93678854efe450889e167ec8df"
server_key_version: "encryptionkey@0"
I20260808 14:36:28.987949 30697 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:36:28.988735 30711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:28.988905 30697 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:28.989017 30697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "ac36f26698ac4c598541b3902fbd9919"
format_stamp: "Formatted at 2026-08-08 14:36:28 on dist-test-slave-8n49"
server_key: "18aec23ba6f4991f9d7811bc9807e861"
server_key_iv: "4c40aa93678854efe450889e167ec8df"
server_key_version: "encryptionkey@0"
I20260808 14:36:28.989094 30697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:29.005191 30697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:29.005520 30697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:29.005677 30697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:29.009892 30697 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:41721
I20260808 14:36:29.010077 30765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:41721 every 8 connection(s)
I20260808 14:36:29.010326 30697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:29.011014 30766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:29.013729 30766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919: Bootstrap starting.
I20260808 14:36:29.014350 30766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:29.014670 30766 log.cc:824] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:29.015184 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 30697
I20260808 14:36:29.015288 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:36:29.015491 30766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919: No bootstrap required, opened a new log
I20260808 14:36:29.015506 20804 external_mini_cluster.cc:1428] Setting key 3284e8118cdeb335b7523b96b22dc24b
I20260808 14:36:29.017774 30766 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac36f26698ac4c598541b3902fbd9919" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41721 } }
I20260808 14:36:29.017915 30766 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:29.017940 30766 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac36f26698ac4c598541b3902fbd9919, State: Initialized, Role: FOLLOWER
I20260808 14:36:29.018071 30766 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac36f26698ac4c598541b3902fbd9919" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41721 } }
I20260808 14:36:29.018162 30766 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:29.018186 30766 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:29.018257 30766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:29.018800 30766 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac36f26698ac4c598541b3902fbd9919" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41721 } }
I20260808 14:36:29.018913 30766 leader_election.cc:302] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac36f26698ac4c598541b3902fbd9919; no voters:
I20260808 14:36:29.019089 30766 leader_election.cc:288] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:29.019146 30771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:29.019340 30766 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:29.019352 30771 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [term 1 LEADER]: Becoming Leader. State: Replica: ac36f26698ac4c598541b3902fbd9919, State: Running, Role: LEADER
I20260808 14:36:29.019562 30771 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac36f26698ac4c598541b3902fbd9919" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41721 } }
I20260808 14:36:29.019976 30774 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac36f26698ac4c598541b3902fbd9919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac36f26698ac4c598541b3902fbd9919" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41721 } } }
I20260808 14:36:29.019964 30771 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac36f26698ac4c598541b3902fbd9919. Latest consensus state: current_term: 1 leader_uuid: "ac36f26698ac4c598541b3902fbd9919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac36f26698ac4c598541b3902fbd9919" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41721 } } }
I20260808 14:36:29.020058 30774 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:29.020071 30771 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:29.020490 30782 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:29.021116 30782 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:29.022488 30770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.016080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56250 (local address 127.20.81.62:41721)
0808 14:36:29.016372 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:29.016380 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:29.016415 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:36:29.016917 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:29.016925 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:29.016983 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:29.017093 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:29.017348 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.018815 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.020011 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.020629 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.020725 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:29.021791 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:29.021795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:29.021795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:36:29.021978 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:29.022011 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:36:29.022022 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:29.022095 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:29.022172 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:36:29.022254 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":144,"threads_started":1}
I20260808 14:36:29.022811 30782 catalog_manager.cc:1347] Generated new cluster ID: 6cb45728425e4e15920f1e2ab8cd6ab1
I20260808 14:36:29.022864 30782 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:29.039544 30782 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:29.040282 30782 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:29.049738 30782 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac36f26698ac4c598541b3902fbd9919: Generated new TSK 0
I20260808 14:36:29.049949 30782 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:36:29.058445 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41721
--builtin_ntp_servers=127.20.81.20:38131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 14:36:29.141809 30792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:29.142055 30792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:29.142092 30792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:29.143266 30792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:29.143333 30792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:29.143378 30792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:36:29.144866 30792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:38131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:29.145136 30792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:29.145445 30792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:29.150626 30798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.150641 30797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.150631 30800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:29.150849 30792 server_base.cc:1034] running on GCE node
I20260808 14:36:29.151081 30792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:29.151332 30792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:29.152463 30792 hybrid_clock.cc:648] HybridClock initialized: now 1786199789152444 us; error 33 us; skew 500 ppm
I20260808 14:36:29.154021 30792 webserver.cc:460] Webserver started at http://127.20.81.1:34435/ using document root <none> and password file <none>
I20260808 14:36:29.154322 30792 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:29.154415 30792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:29.154562 30792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:29.156065 30792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "1703305b2ac74682b0ea0bf2899b76de"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "22685d2debe7679c1bbefad8ff66b7fa"
server_key_iv: "954a75dec11573cc945eb7dcf412bd17"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.156454 30792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "1703305b2ac74682b0ea0bf2899b76de"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "22685d2debe7679c1bbefad8ff66b7fa"
server_key_iv: "954a75dec11573cc945eb7dcf412bd17"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.157832 30792 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:36:29.158706 30806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.158907 30792 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:29.159021 30792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "1703305b2ac74682b0ea0bf2899b76de"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "22685d2debe7679c1bbefad8ff66b7fa"
server_key_iv: "954a75dec11573cc945eb7dcf412bd17"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.159101 30792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:29.178190 30792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:29.178525 30792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:29.178679 30792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:29.178918 30792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:29.179291 30792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:29.179351 30792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.179395 30792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:29.179423 30792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.185210 30792 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:38147
I20260808 14:36:29.185293 30926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:38147 every 8 connection(s)
I20260808 14:36:29.185626 30792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:29.190822 30770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.186407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:40909 (local address 127.20.81.62:41721)
0808 14:36:29.186486 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:29.186489 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:29.186744 (+ 255us) server_negotiation.cc:407] Connection header received
0808 14:36:29.187229 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:29.187230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:29.187244 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:29.187302 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:29.187998 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.188494 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.189488 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.189670 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.189725 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:29.190559 (+ 834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:29.190560 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:29.190560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:36:29.190565 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:29.190579 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:36:29.190583 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:29.190655 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:29.190740 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:36:29.190762 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:36:29.191156 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.186408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41721 (local address 127.20.81.1:40909)
0808 14:36:29.186617 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:29.186652 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:29.187145 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:29.187383 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:29.187386 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:29.187395 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:29.187920 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:29.187925 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.188627 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.188628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:29.189406 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:29.189408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.189747 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.189748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:29.189852 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:29.190406 (+ 554us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:36:29.190407 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:29.190435 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:36:29.190457 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:29.190667 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:29.190672 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:29.190674 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:36:29.190727 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:36:29.190804 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":97,"threads_started":1}
I20260808 14:36:29.191804 30927 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41721
I20260808 14:36:29.191916 30927 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:29.192101 30927 heartbeater.cc:511] Master 127.20.81.62:41721 requested a full tablet report, sending...
I20260808 14:36:29.192714 30728 ts_manager.cc:194] Registered new tserver with Master: 1703305b2ac74682b0ea0bf2899b76de (127.20.81.1:38147)
I20260808 14:36:29.193357 30728 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.1:40909
I20260808 14:36:29.194165 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 30792
I20260808 14:36:29.194273 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:36:29.194518 20804 external_mini_cluster.cc:1428] Setting key 08427707c1cd4db63194d0f2d54c9dd0
I20260808 14:36:29.195641 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41721
--builtin_ntp_servers=127.20.81.20:38131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 14:36:29.286496 30930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:29.286782 30930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:29.286819 30930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:29.288867 30930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:29.288931 30930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:29.288981 30930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:36:29.290930 30930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:38131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:29.291224 30930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:29.291666 30930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:29.297894 30935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.297972 30936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:29.298130 30930 server_base.cc:1034] running on GCE node
W20260808 14:36:29.297899 30938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:29.298465 30930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:29.298779 30930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:29.299975 30930 hybrid_clock.cc:648] HybridClock initialized: now 1786199789299952 us; error 40 us; skew 500 ppm
I20260808 14:36:29.301388 30930 webserver.cc:460] Webserver started at http://127.20.81.2:36171/ using document root <none> and password file <none>
I20260808 14:36:29.301657 30930 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:29.301730 30930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:29.301874 30930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:29.303395 30930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "b38034a3e37d4e9db7e4c38db29b7cbb"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "660fc55177cf357c7d3be78bf1e89693"
server_key_iv: "fc85130a78cf83ba5aa8d05f8907ffa4"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.303812 30930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "b38034a3e37d4e9db7e4c38db29b7cbb"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "660fc55177cf357c7d3be78bf1e89693"
server_key_iv: "fc85130a78cf83ba5aa8d05f8907ffa4"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.305383 30930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 14:36:29.306242 30946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.306438 30930 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:29.306530 30930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "b38034a3e37d4e9db7e4c38db29b7cbb"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "660fc55177cf357c7d3be78bf1e89693"
server_key_iv: "fc85130a78cf83ba5aa8d05f8907ffa4"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.306639 30930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:29.331761 30930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:29.332119 30930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:29.332283 30930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:29.332592 30930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:29.332978 30930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:29.333043 30930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.333079 30930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:29.333105 30930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.339118 30930 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:34693
I20260808 14:36:29.339185 31066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:34693 every 8 connection(s)
I20260808 14:36:29.339600 30930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:29.341169 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 30930
I20260808 14:36:29.341291 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:29.341495 20804 external_mini_cluster.cc:1428] Setting key 4c25ef7b5de51f565711cda1dbc2bcb9
I20260808 14:36:29.342486 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41721
--builtin_ntp_servers=127.20.81.20:38131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:36:29.349488 30770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.340444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:35487 (local address 127.20.81.62:41721)
0808 14:36:29.340506 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:29.340508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:29.340886 (+ 378us) server_negotiation.cc:407] Connection header received
0808 14:36:29.341524 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:29.341526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:29.341541 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:29.341594 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:29.342450 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.343217 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.344237 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.344452 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.344543 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:29.349146 (+ 4603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:29.349148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:29.349148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:36:29.349154 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:29.349172 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:36:29.349176 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:29.349253 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:29.349367 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 14:36:29.349400 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:36:29.349746 31069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.340453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41721 (local address 127.20.81.2:35487)
0808 14:36:29.340742 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:29.340796 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:29.341393 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:29.341667 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:29.341672 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:29.341683 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:29.342357 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:29.342364 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.343315 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.343316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:29.344141 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:29.344143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.344576 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.344577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:29.344727 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:29.348937 (+ 4210us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:36:29.348938 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:29.348975 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:36:29.349003 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:29.349255 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:29.349267 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:29.349271 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:29.349358 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:36:29.349512 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":140,"threads_started":1}
I20260808 14:36:29.350329 31067 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41721
I20260808 14:36:29.350421 31067 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:29.350643 31067 heartbeater.cc:511] Master 127.20.81.62:41721 requested a full tablet report, sending...
I20260808 14:36:29.351092 30728 ts_manager.cc:194] Registered new tserver with Master: b38034a3e37d4e9db7e4c38db29b7cbb (127.20.81.2:34693)
I20260808 14:36:29.351585 30728 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.2:35487
W20260808 14:36:29.429369 31070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:29.429574 31070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:29.429596 31070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:29.430745 31070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:29.430787 31070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:29.430840 31070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:36:29.432204 31070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:38131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:29.432477 31070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:29.432812 31070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:29.437960 31079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.438004 31076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:29.438159 31070 server_base.cc:1034] running on GCE node
W20260808 14:36:29.438177 31077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:29.438452 31070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:29.438714 31070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:29.439908 31070 hybrid_clock.cc:648] HybridClock initialized: now 1786199789439880 us; error 40 us; skew 500 ppm
I20260808 14:36:29.441258 31070 webserver.cc:460] Webserver started at http://127.20.81.3:34757/ using document root <none> and password file <none>
I20260808 14:36:29.441524 31070 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:29.441598 31070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:29.441752 31070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:29.442858 31070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "dde1640ac423424d9a024b534f482632"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "c72bf5034869d0324be20dd36112a841"
server_key_iv: "5141c010508595bc68fb724259811277"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.443228 31070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "dde1640ac423424d9a024b534f482632"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "c72bf5034869d0324be20dd36112a841"
server_key_iv: "5141c010508595bc68fb724259811277"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.444599 31070 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:36:29.445379 31085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.445560 31070 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:29.445662 31070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "dde1640ac423424d9a024b534f482632"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "c72bf5034869d0324be20dd36112a841"
server_key_iv: "5141c010508595bc68fb724259811277"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.445745 31070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:29.462721 31070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:29.463047 31070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:29.463202 31070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:29.463438 31070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:29.463786 31070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:29.463845 31070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.463887 31070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:29.463917 31070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.469926 31070 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:39823
I20260808 14:36:29.469980 31208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:39823 every 8 connection(s)
I20260808 14:36:29.470312 31070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:29.475667 30770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.471131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:40161 (local address 127.20.81.62:41721)
0808 14:36:29.471180 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:29.471182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:29.471447 (+ 265us) server_negotiation.cc:407] Connection header received
0808 14:36:29.472009 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:29.472010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:29.472025 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:29.472083 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:29.472801 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.473316 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.474296 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.474493 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.474572 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:29.475349 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:29.475350 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:29.475350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:36:29.475354 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:29.475369 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:36:29.475373 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:29.475441 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:29.475558 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:36:29.475586 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:36:29.475888 31211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.471106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41721 (local address 127.20.81.3:40161)
0808 14:36:29.471323 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:29.471356 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:29.471891 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:29.472160 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:29.472164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:29.472172 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:29.472703 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:29.472707 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.473413 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.473414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:29.474201 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:29.474203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:29.474578 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:29.474579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:29.474713 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:29.475206 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:36:29.475207 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:29.475236 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:36:29.475258 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:29.475442 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:29.475448 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:29.475452 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:29.475559 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 14:36:29.475657 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":83,"threads_started":1}
I20260808 14:36:29.476398 31209 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41721
I20260808 14:36:29.476502 31209 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:29.476706 31209 heartbeater.cc:511] Master 127.20.81.62:41721 requested a full tablet report, sending...
I20260808 14:36:29.477104 30728 ts_manager.cc:194] Registered new tserver with Master: dde1640ac423424d9a024b534f482632 (127.20.81.3:39823)
I20260808 14:36:29.477458 30728 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.3:40161
I20260808 14:36:29.478407 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 31070
I20260808 14:36:29.478523 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:29.478721 20804 external_mini_cluster.cc:1428] Setting key ed01df296243fa1861c827f94b38826b
I20260808 14:36:29.479652 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:36:29.481416 30770 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:29.480986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56256 (local address 127.20.81.62:41721)
0808 14:36:29.481020 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:29.481022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:29.481168 (+ 146us) server_negotiation.cc:407] Connection header received
0808 14:36:29.481206 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:29.481206 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:29.481214 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:29.481261 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:29.481372 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56256: BlockingRecv error: recv got EOF from 127.0.0.1:56256 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:36:29.481516 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 30792
I20260808 14:36:29.493268 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 30930
I20260808 14:36:29.499450 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 31070
I20260808 14:36:29.504464 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 30697
2026-08-08T14:36:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (641 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T14:36:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:29Z Disabled control of system clock
I20260808 14:36:29.533162 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:38349
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:42199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:38349
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:36:29.615346 31220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:29.615557 31220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:29.615579 31220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:29.616767 31220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:29.616809 31220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:29.616822 31220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:29.616835 31220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:29.616889 31220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:29.618309 31220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:38349
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:38349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:29.618585 31220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:29.618884 31220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:29.623875 31226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.623910 31229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.623870 31227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:29.624169 31220 server_base.cc:1034] running on GCE node
I20260808 14:36:29.624493 31220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:29.624818 31220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:29.625982 31220 hybrid_clock.cc:648] HybridClock initialized: now 1786199789625962 us; error 46 us; skew 500 ppm
I20260808 14:36:29.627204 31220 webserver.cc:460] Webserver started at http://127.20.81.62:43717/ using document root <none> and password file <none>
I20260808 14:36:29.627444 31220 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:29.627487 31220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:29.627578 31220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:29.628676 31220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "0be1882b05f341a8846ff9df0951f31f"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "e7ad6454c202ce0623cb70d352b5d204"
server_key_iv: "ab7d757474752fa2bb4ff7979ccef076"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.629019 31220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "0be1882b05f341a8846ff9df0951f31f"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "e7ad6454c202ce0623cb70d352b5d204"
server_key_iv: "ab7d757474752fa2bb4ff7979ccef076"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.630275 31220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:29.631047 31236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.631278 31220 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:29.631402 31220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "0be1882b05f341a8846ff9df0951f31f"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "e7ad6454c202ce0623cb70d352b5d204"
server_key_iv: "ab7d757474752fa2bb4ff7979ccef076"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.631500 31220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:29.634815 31220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:29.635089 31220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:29.635233 31220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:29.639084 31220 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:38349
I20260808 14:36:29.639142 31291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:38349 every 8 connection(s)
I20260808 14:36:29.639492 31220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:29.640201 31292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:29.643584 31292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f: Bootstrap starting.
I20260808 14:36:29.644207 31292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:29.644515 31292 log.cc:824] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:29.645273 31292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f: No bootstrap required, opened a new log
I20260808 14:36:29.646828 31292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be1882b05f341a8846ff9df0951f31f" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38349 } }
I20260808 14:36:29.646976 31292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:29.647001 31292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be1882b05f341a8846ff9df0951f31f, State: Initialized, Role: FOLLOWER
I20260808 14:36:29.647138 31292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be1882b05f341a8846ff9df0951f31f" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38349 } }
I20260808 14:36:29.647233 31292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:29.647256 31292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:29.647285 31292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:29.647763 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 31220
I20260808 14:36:29.647796 31292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be1882b05f341a8846ff9df0951f31f" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38349 } }
I20260808 14:36:29.647954 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:36:29.647964 31292 leader_election.cc:302] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0be1882b05f341a8846ff9df0951f31f; no voters:
I20260808 14:36:29.648156 31292 leader_election.cc:288] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:29.648181 20804 external_mini_cluster.cc:1428] Setting key cd874e7ee828e42c09e15af9789ff82e
I20260808 14:36:29.648193 31296 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:29.648311 31296 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [term 1 LEADER]: Becoming Leader. State: Replica: 0be1882b05f341a8846ff9df0951f31f, State: Running, Role: LEADER
I20260808 14:36:29.648428 31292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:29.648402 31296 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be1882b05f341a8846ff9df0951f31f" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38349 } }
I20260808 14:36:29.648752 31296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0be1882b05f341a8846ff9df0951f31f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be1882b05f341a8846ff9df0951f31f" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38349 } } }
I20260808 14:36:29.648838 31296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:29.648967 31296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0be1882b05f341a8846ff9df0951f31f. Latest consensus state: current_term: 1 leader_uuid: "0be1882b05f341a8846ff9df0951f31f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be1882b05f341a8846ff9df0951f31f" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38349 } } }
I20260808 14:36:29.649022 31296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:29.649430 31302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:29.649969 31302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:29.651825 31302 catalog_manager.cc:1347] Generated new cluster ID: e11f6bc9aba046e7a655aaee49cb487d
I20260808 14:36:29.651883 31302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:29.651870 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.648731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39542 (local address 127.20.81.62:38349)
0808 14:36:29.649971 (+ 1240us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:29.649981 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:29.650018 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:36:29.650151 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:29.650160 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:29.650211 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:29.650652 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:29.651399 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:29.651402 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:29.651402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:36:29.651405 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:29.651441 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:36:29.651451 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:29.651529 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:29.651625 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:36:29.651682 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1154,"thread_start_us":71,"threads_started":1}
I20260808 14:36:29.656359 31302 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:29.656586 31302 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:29.662271 31302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0be1882b05f341a8846ff9df0951f31f: Generated new TSK 0
I20260808 14:36:29.662469 31302 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:36:29.667318 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38349
--builtin_ntp_servers=127.20.81.20:42199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:36:29.755770 31318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:29.755972 31318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:29.755995 31318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:29.757182 31318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:29.757220 31318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:29.757246 31318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:36:29.758591 31318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:29.758838 31318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:29.759153 31318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:29.764914 31324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.764925 31323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.764983 31326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:29.765247 31318 server_base.cc:1034] running on GCE node
I20260808 14:36:29.765462 31318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:29.765697 31318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:29.766867 31318 hybrid_clock.cc:648] HybridClock initialized: now 1786199789766846 us; error 39 us; skew 500 ppm
I20260808 14:36:29.768203 31318 webserver.cc:460] Webserver started at http://127.20.81.1:43699/ using document root <none> and password file <none>
I20260808 14:36:29.768446 31318 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:29.768517 31318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:29.768703 31318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:29.769789 31318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "176addee09f54f0884d5d752ffbc78b7"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "418c887dc4467f82da42ce606bb7f559"
server_key_iv: "5a34b344ed147d6c733474ea924c9bd7"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.770162 31318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "176addee09f54f0884d5d752ffbc78b7"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "418c887dc4467f82da42ce606bb7f559"
server_key_iv: "5a34b344ed147d6c733474ea924c9bd7"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.771522 31318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:36:29.772306 31333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.772527 31318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:29.772655 31318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "176addee09f54f0884d5d752ffbc78b7"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "418c887dc4467f82da42ce606bb7f559"
server_key_iv: "5a34b344ed147d6c733474ea924c9bd7"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.772737 31318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:29.776024 31318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:29.776290 31318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:29.776444 31318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:29.776696 31318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:29.777051 31318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:29.777103 31318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.777143 31318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:29.777170 31318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.784202 31318 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:45657
I20260808 14:36:29.784253 31450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:45657 every 8 connection(s)
I20260808 14:36:29.784669 31318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:29.787487 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.785394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:53105 (local address 127.20.81.62:38349)
0808 14:36:29.785464 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:29.785466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:29.785684 (+ 218us) server_negotiation.cc:407] Connection header received
0808 14:36:29.786131 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:29.786132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:29.786138 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:29.786190 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:29.787275 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:29.787276 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:29.787277 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:36:29.787281 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:29.787296 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:36:29.787300 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:29.787347 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:29.787402 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 14:36:29.787415 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:36:29.787633 31453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.785384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:38349 (local address 127.20.81.1:53105)
0808 14:36:29.785561 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:29.785594 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:29.786039 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:29.786242 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:29.786245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:29.786253 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:29.787132 (+ 879us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:36:29.787133 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:29.787161 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:36:29.787190 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:29.787345 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:29.787347 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:29.787349 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:36:29.787400 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:36:29.787445 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":93,"threads_started":1}
I20260808 14:36:29.788128 31451 heartbeater.cc:347] Connected to a master server at 127.20.81.62:38349
I20260808 14:36:29.788205 31451 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:29.788371 31451 heartbeater.cc:511] Master 127.20.81.62:38349 requested a full tablet report, sending...
I20260808 14:36:29.788947 31253 ts_manager.cc:194] Registered new tserver with Master: 176addee09f54f0884d5d752ffbc78b7 (127.20.81.1:45657)
I20260808 14:36:29.793292 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 31318
I20260808 14:36:29.793375 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:36:29.793588 20804 external_mini_cluster.cc:1428] Setting key 6ba6a257ee6c55a8f068e44a419ddf73
I20260808 14:36:29.794512 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38349
--builtin_ntp_servers=127.20.81.20:42199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:36:29.875911 31454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:29.876142 31454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:29.876178 31454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:29.877409 31454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:29.877472 31454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:29.877518 31454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:36:29.878875 31454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:29.879160 31454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:29.879462 31454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:29.884356 31459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.884342 31460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:29.884343 31463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:29.884616 31454 server_base.cc:1034] running on GCE node
I20260808 14:36:29.884815 31454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:29.885063 31454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:29.886224 31454 hybrid_clock.cc:648] HybridClock initialized: now 1786199789886212 us; error 45 us; skew 500 ppm
I20260808 14:36:29.887401 31454 webserver.cc:460] Webserver started at http://127.20.81.2:41221/ using document root <none> and password file <none>
I20260808 14:36:29.887671 31454 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:29.887741 31454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:29.887887 31454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:29.889007 31454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "2487e4d7ec9a4917ad1097fd7862ac0f"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "43a9971cbae4d9ae813f3b83b1e50743"
server_key_iv: "7c098af57dc0848e9807e564bc09310c"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.889372 31454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "2487e4d7ec9a4917ad1097fd7862ac0f"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "43a9971cbae4d9ae813f3b83b1e50743"
server_key_iv: "7c098af57dc0848e9807e564bc09310c"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.890673 31454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:36:29.891373 31470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.891552 31454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:29.891649 31454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "2487e4d7ec9a4917ad1097fd7862ac0f"
format_stamp: "Formatted at 2026-08-08 14:36:29 on dist-test-slave-8n49"
server_key: "43a9971cbae4d9ae813f3b83b1e50743"
server_key_iv: "7c098af57dc0848e9807e564bc09310c"
server_key_version: "encryptionkey@0"
I20260808 14:36:29.891731 31454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:29.895083 31454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:29.895354 31454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:29.895495 31454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:29.895714 31454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:29.896021 31454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:29.896076 31454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.896116 31454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:29.896143 31454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:29.901965 31454 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:43999
I20260808 14:36:29.902006 31586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:43999 every 8 connection(s)
I20260808 14:36:29.902393 31454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:29.906261 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.903918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:44305 (local address 127.20.81.62:38349)
0808 14:36:29.903984 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:29.903987 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:29.904218 (+ 231us) server_negotiation.cc:407] Connection header received
0808 14:36:29.904795 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:29.904797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:29.904805 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:29.904858 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:29.905954 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:29.905955 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:29.905956 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:36:29.905960 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:29.905978 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:36:29.905983 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:29.906058 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:29.906173 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 14:36:29.906190 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:36:29.906454 31589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:29.903896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:38349 (local address 127.20.81.2:44305)
0808 14:36:29.904101 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:29.904131 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:29.904677 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:29.904925 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:29.904929 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:29.904939 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:29.905789 (+ 850us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:36:29.905790 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:29.905817 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:36:29.905845 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:29.906056 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:29.906063 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:29.906066 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:36:29.906181 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:36:29.906243 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260808 14:36:29.906957 31587 heartbeater.cc:347] Connected to a master server at 127.20.81.62:38349
I20260808 14:36:29.907035 31587 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:29.907208 31587 heartbeater.cc:511] Master 127.20.81.62:38349 requested a full tablet report, sending...
I20260808 14:36:29.907622 31253 ts_manager.cc:194] Registered new tserver with Master: 2487e4d7ec9a4917ad1097fd7862ac0f (127.20.81.2:43999)
I20260808 14:36:29.909641 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 31454
I20260808 14:36:29.909724 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:29.909873 20804 external_mini_cluster.cc:1428] Setting key 6983bd3690cef384ab1511a99bcf2d69
I20260808 14:36:29.910772 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38349
--builtin_ntp_servers=127.20.81.20:42199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:36:29.994297 31590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:29.994488 31590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:29.994509 31590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:29.995723 31590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:29.995760 31590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:29.995786 31590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:36:29.997133 31590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:29.997330 31590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:29.997561 31590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:30.002462 31596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:30.002463 31595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:30.002492 31598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:30.002624 31590 server_base.cc:1034] running on GCE node
I20260808 14:36:30.002912 31590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:30.003170 31590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:30.004331 31590 hybrid_clock.cc:648] HybridClock initialized: now 1786199790004309 us; error 44 us; skew 500 ppm
I20260808 14:36:30.005651 31590 webserver.cc:460] Webserver started at http://127.20.81.3:42797/ using document root <none> and password file <none>
I20260808 14:36:30.005896 31590 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:30.005965 31590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:30.006102 31590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:30.007184 31590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "91d366905f174ec2a424c62ff3bfd454"
format_stamp: "Formatted at 2026-08-08 14:36:30 on dist-test-slave-8n49"
server_key: "2b5d612b1f467b5bea271e184029d13b"
server_key_iv: "dc5a1e91b7597f224d0636a9d5ea1d25"
server_key_version: "encryptionkey@0"
I20260808 14:36:30.007562 31590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "91d366905f174ec2a424c62ff3bfd454"
format_stamp: "Formatted at 2026-08-08 14:36:30 on dist-test-slave-8n49"
server_key: "2b5d612b1f467b5bea271e184029d13b"
server_key_iv: "dc5a1e91b7597f224d0636a9d5ea1d25"
server_key_version: "encryptionkey@0"
I20260808 14:36:30.008991 31590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:36:30.009778 31605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:30.009955 31590 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:30.010063 31590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "91d366905f174ec2a424c62ff3bfd454"
format_stamp: "Formatted at 2026-08-08 14:36:30 on dist-test-slave-8n49"
server_key: "2b5d612b1f467b5bea271e184029d13b"
server_key_iv: "dc5a1e91b7597f224d0636a9d5ea1d25"
server_key_version: "encryptionkey@0"
I20260808 14:36:30.010149 31590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:30.013572 31590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:30.013834 31590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:30.013983 31590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:30.014205 31590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:30.014520 31590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:30.014575 31590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:30.014614 31590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:30.014642 31590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:30.020639 31590 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:35981
I20260808 14:36:30.020694 31727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:35981 every 8 connection(s)
I20260808 14:36:30.021011 31590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:30.024135 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:30.021727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:47401 (local address 127.20.81.62:38349)
0808 14:36:30.021794 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:30.021796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:30.022035 (+ 239us) server_negotiation.cc:407] Connection header received
0808 14:36:30.022548 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:30.022549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:30.022556 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:30.022610 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:30.023844 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:30.023845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:30.023845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:36:30.023850 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:30.023866 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:36:30.023870 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:30.023947 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:30.024044 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 14:36:30.024062 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:36:30.024336 31730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:30.021722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:38349 (local address 127.20.81.3:47401)
0808 14:36:30.021911 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:30.021944 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:30.022429 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:30.022681 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:30.022685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:30.022695 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:30.023667 (+ 972us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:36:30.023668 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:30.023697 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:36:30.023725 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:30.023945 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:30.023952 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:30.023955 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:36:30.024051 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:36:30.024114 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260808 14:36:30.024907 31728 heartbeater.cc:347] Connected to a master server at 127.20.81.62:38349
I20260808 14:36:30.025002 31728 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:30.025158 31728 heartbeater.cc:511] Master 127.20.81.62:38349 requested a full tablet report, sending...
I20260808 14:36:30.025581 31253 ts_manager.cc:194] Registered new tserver with Master: 91d366905f174ec2a424c62ff3bfd454 (127.20.81.3:35981)
I20260808 14:36:30.025998 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 31590
I20260808 14:36:30.026082 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:30.026281 20804 external_mini_cluster.cc:1428] Setting key 01774b01356c5171c00d34326a03fb11
I20260808 14:36:30.027221 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:36:30.029107 31301 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:30.028639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39556 (local address 127.20.81.62:38349)
0808 14:36:30.028704 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:30.028706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:30.028878 (+ 172us) server_negotiation.cc:407] Connection header received
0808 14:36:30.028905 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:30.028906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:30.028913 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:30.028963 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:30.029062 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39556: BlockingRecv error: recv got EOF from 127.0.0.1:39556 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:36:30.029254 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 31318
I20260808 14:36:30.038452 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 31454
I20260808 14:36:30.045209 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 31590
I20260808 14:36:30.051554 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 31220
2026-08-08T14:36:30Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (547 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:30 dist-test-slave-8n49 krb5kdc[31738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:30 dist-test-slave-8n49 krb5kdc[31738](info): set up 2 sockets
Aug 08 14:36:30 dist-test-slave-8n49 krb5kdc[31738](info): commencing operation
krb5kdc: starting...
W20260808 14:36:31.153466 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:36:31 dist-test-slave-8n49 krb5kdc[31738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:36:31.276180 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40811
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:40811
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:31.361382 31752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:31.361616 31752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:31.361655 31752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:31.362788 31752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:31.362854 31752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:31.362880 31752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:31.362914 31752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:31.362939 31752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:31.364395 31752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:40811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:31.364694 31752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:31.364917 31752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:31.369736 31757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:31.369706 31762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:31.369827 31758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:31.370317 31752 server_base.cc:1034] running on GCE node
I20260808 14:36:31.370563 31752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:31.370855 31752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:31.372042 31752 hybrid_clock.cc:648] HybridClock initialized: now 1786199791372033 us; error 38 us; skew 500 ppm
Aug 08 14:36:31 dist-test-slave-8n49 krb5kdc[31738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:31.375144 31752 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:36:31.375708 31752 webserver.cc:460] Webserver started at http://127.20.81.62:34079/ using document root <none> and password file <none>
I20260808 14:36:31.375972 31752 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:31.376035 31752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:31.376169 31752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:31.377633 31752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "a8c3afc1bfc64ff8938a7e6d88847866"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "5de8edaf90e2c3f12eed7d91d92da129"
server_key_iv: "b4301c38de2711f1372e4b76b3fee465"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.378078 31752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "a8c3afc1bfc64ff8938a7e6d88847866"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "5de8edaf90e2c3f12eed7d91d92da129"
server_key_iv: "b4301c38de2711f1372e4b76b3fee465"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.379745 31752 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:36:31.380442 31769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.380664 31752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:31.380740 31752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "a8c3afc1bfc64ff8938a7e6d88847866"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "5de8edaf90e2c3f12eed7d91d92da129"
server_key_iv: "b4301c38de2711f1372e4b76b3fee465"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.380831 31752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:31.396899 31752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:31.399152 31752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:31.399302 31752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:31.403328 31752 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:40811
I20260808 14:36:31.403406 31823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:40811 every 8 connection(s)
I20260808 14:36:31.403736 31752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:31.404831 31824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:31.407158 31824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866: Bootstrap starting.
I20260808 14:36:31.407769 31824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:31.408080 31824 log.cc:824] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:31.408849 31824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866: No bootstrap required, opened a new log
I20260808 14:36:31.410493 31824 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c3afc1bfc64ff8938a7e6d88847866" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40811 } }
I20260808 14:36:31.410633 31824 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:31.410655 31824 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c3afc1bfc64ff8938a7e6d88847866, State: Initialized, Role: FOLLOWER
I20260808 14:36:31.410807 31824 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c3afc1bfc64ff8938a7e6d88847866" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40811 } }
I20260808 14:36:31.410880 31824 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:31.410928 31824 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:31.410977 31824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:31.411264 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 31752
I20260808 14:36:31.411382 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:36:31.411585 20804 external_mini_cluster.cc:1428] Setting key 77c2c785bac8e9db04c757bbf3078b03
I20260808 14:36:31.411947 31824 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c3afc1bfc64ff8938a7e6d88847866" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40811 } }
I20260808 14:36:31.412062 31824 leader_election.cc:302] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8c3afc1bfc64ff8938a7e6d88847866; no voters:
I20260808 14:36:31.412251 31824 leader_election.cc:288] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:31.412284 31829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:31.412475 31829 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [term 1 LEADER]: Becoming Leader. State: Replica: a8c3afc1bfc64ff8938a7e6d88847866, State: Running, Role: LEADER
I20260808 14:36:31.412519 31824 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:31.412599 31829 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c3afc1bfc64ff8938a7e6d88847866" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40811 } }
I20260808 14:36:31.412902 31832 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8c3afc1bfc64ff8938a7e6d88847866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c3afc1bfc64ff8938a7e6d88847866" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40811 } } }
I20260808 14:36:31.413017 31832 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:31.413393 31837 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:31.413945 31837 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:31.412906 31830 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8c3afc1bfc64ff8938a7e6d88847866. Latest consensus state: current_term: 1 leader_uuid: "a8c3afc1bfc64ff8938a7e6d88847866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c3afc1bfc64ff8938a7e6d88847866" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40811 } } }
I20260808 14:36:31.414767 31830 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:31.415611 31837 catalog_manager.cc:1347] Generated new cluster ID: 10d95f8c07974947a0921e542ed41b8c
I20260808 14:36:31.415664 31837 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:36:31 dist-test-slave-8n49 krb5kdc[31738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:31.423648 31828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.412079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60504 (local address 127.20.81.62:40811)
0808 14:36:31.412260 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.412270 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.412436 (+ 166us) server_negotiation.cc:407] Connection header received
0808 14:36:31.412750 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.412760 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.412819 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.413004 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:31.413845 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.415241 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.416284 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.416886 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.416985 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.419810 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:31.419815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:31.419815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:31.419830 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:31.421971 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.422359 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.422363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.422364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.422495 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.422705 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.422706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.422707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.423033 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:31.423211 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.423279 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.423431 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260808 14:36:31.424670 31837 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:31.425354 31837 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:31.433825 31837 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866: Generated new TSK 0
I20260808 14:36:31.434042 31837 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:36:31.461575 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:40811
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:31.544410 31852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:31.544646 31852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:31.544672 31852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:31.545851 31852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:31.545894 31852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:31.545920 31852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:36:31.547458 31852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:40811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:31.547722 31852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:31.547969 31852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:31.553167 31859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:31.553167 31861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:31.553226 31858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:31.553251 31852 server_base.cc:1034] running on GCE node
I20260808 14:36:31.553586 31852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:31.553865 31852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:31.555017 31852 hybrid_clock.cc:648] HybridClock initialized: now 1786199791554992 us; error 38 us; skew 500 ppm
Aug 08 14:36:31 dist-test-slave-8n49 krb5kdc[31738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:31.557624 31852 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:36:31.558044 31852 webserver.cc:460] Webserver started at http://127.20.81.1:46559/ using document root <none> and password file <none>
I20260808 14:36:31.558293 31852 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:31.558362 31852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:31.558507 31852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:31.559542 31852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "def56dbf9b1b4a5e8861d221b3c1450b"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "1574f8245dc37a773d5562627ccb28b6"
server_key_iv: "2ecc5c8a82ebe9c29b05806327ea7dd1"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.559911 31852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "def56dbf9b1b4a5e8861d221b3c1450b"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "1574f8245dc37a773d5562627ccb28b6"
server_key_iv: "2ecc5c8a82ebe9c29b05806327ea7dd1"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.561299 31852 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:36:31.562017 31868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.562181 31852 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:31.562286 31852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "def56dbf9b1b4a5e8861d221b3c1450b"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "1574f8245dc37a773d5562627ccb28b6"
server_key_iv: "2ecc5c8a82ebe9c29b05806327ea7dd1"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.562363 31852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:31.579370 31852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:31.581281 31852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:31.581439 31852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:31.581660 31852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:31.581959 31852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:31.582015 31852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.582055 31852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:31.582086 31852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.587728 31852 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:43395
I20260808 14:36:31.587788 31990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:43395 every 8 connection(s)
I20260808 14:36:31.588122 31852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:36:31 dist-test-slave-8n49 krb5kdc[31738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:31.596876 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 31852
I20260808 14:36:31.596992 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:36:31.597204 20804 external_mini_cluster.cc:1428] Setting key 3f5ed20e77e9505d177f484856e1029c
I20260808 14:36:31.597420 31828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.588901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:39117 (local address 127.20.81.62:40811)
0808 14:36:31.588972 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.588974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.589176 (+ 202us) server_negotiation.cc:407] Connection header received
0808 14:36:31.589654 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.589655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.589669 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.589717 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:31.590633 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.591158 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.592174 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.592380 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.592468 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.594734 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:31.594735 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:31.594735 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:31.594742 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:31.595972 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.596357 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.596358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.596358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.596428 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.596714 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.596715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.596715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.596825 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:31.596911 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.597237 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.597330 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:36:31.597612 31993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.588883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:40811 (local address 127.20.81.1:39117)
0808 14:36:31.589052 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:31.589087 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:31.589567 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:31.589777 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:31.589780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:31.590331 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:31.590520 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.590525 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.591258 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.591259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.592076 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.592079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.592487 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.592488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.592764 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.593232 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:31.593240 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:31.594642 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:31.596047 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:31.596054 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:31.596056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:31.596263 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:31.596498 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:31.596498 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:31.596499 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:31.596663 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:31.596905 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:31.596913 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:31.597077 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 14:36:31.597212 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 14:36:31.597370 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260808 14:36:31.598115 31991 heartbeater.cc:347] Connected to a master server at 127.20.81.62:40811
I20260808 14:36:31.598222 31991 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:31.598397 31991 heartbeater.cc:511] Master 127.20.81.62:40811 requested a full tablet report, sending...
I20260808 14:36:31.598979 31785 ts_manager.cc:194] Registered new tserver with Master: def56dbf9b1b4a5e8861d221b3c1450b (127.20.81.1:43395)
I20260808 14:36:31.599882 31785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:39117
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:36:31.625705 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:40811
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:31.706494 31996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:31.706732 31996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:31.706770 31996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:31.707916 31996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:31.707986 31996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:31.708031 31996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:36:31.709515 31996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:40811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:31.709784 31996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:31.710011 31996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:31.715102 32006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:31.715160 32004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:31.715111 32003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:31.715296 31996 server_base.cc:1034] running on GCE node
I20260808 14:36:31.715618 31996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:31.715870 31996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:31.717041 31996 hybrid_clock.cc:648] HybridClock initialized: now 1786199791717039 us; error 40 us; skew 500 ppm
Aug 08 14:36:31 dist-test-slave-8n49 krb5kdc[31738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:31.719515 31996 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:36:31.719928 31996 webserver.cc:460] Webserver started at http://127.20.81.2:37895/ using document root <none> and password file <none>
I20260808 14:36:31.720118 31996 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:31.720158 31996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:31.720245 31996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:31.721312 31996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "5acd5d1f60224a2095a737ef1eb5c3a2"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "9ab76fe27282fd091329da097833c531"
server_key_iv: "7fa34ac522c64c476ebba8baff6dd22d"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.721622 31996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "5acd5d1f60224a2095a737ef1eb5c3a2"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "9ab76fe27282fd091329da097833c531"
server_key_iv: "7fa34ac522c64c476ebba8baff6dd22d"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.722875 31996 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:36:31.723567 32014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.723721 31996 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:36:31.723789 31996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "5acd5d1f60224a2095a737ef1eb5c3a2"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "9ab76fe27282fd091329da097833c531"
server_key_iv: "7fa34ac522c64c476ebba8baff6dd22d"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.723841 31996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:31.748976 31996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:31.751080 31996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:31.751231 31996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:31.751462 31996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:31.751777 31996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:31.751833 31996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.751878 31996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:31.751905 31996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.757826 31996 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:37847
I20260808 14:36:31.757871 32135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:37847 every 8 connection(s)
I20260808 14:36:31.758193 31996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:31.761057 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 31996
I20260808 14:36:31.761142 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:31.761329 20804 external_mini_cluster.cc:1428] Setting key b09d45c858a8d7233903f0235219ef1b
Aug 08 14:36:31 dist-test-slave-8n49 krb5kdc[31738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:31.768369 31828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.759050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:50983 (local address 127.20.81.62:40811)
0808 14:36:31.759115 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.759117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.759252 (+ 135us) server_negotiation.cc:407] Connection header received
0808 14:36:31.759756 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.759757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.759768 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.759830 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:31.760811 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.761469 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.762535 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.762739 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.762819 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.765375 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:31.765376 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:31.765376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:31.765384 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:31.766871 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.767384 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.767385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.767385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.767439 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.767746 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.767746 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.767747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.767846 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:31.767893 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.768238 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.768306 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:36:31.768680 32138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.758938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:40811 (local address 127.20.81.2:50983)
0808 14:36:31.759121 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:31.759163 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:31.759663 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:31.759908 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:31.759912 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:31.760495 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:31.760700 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.760705 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.761589 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.761590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.762409 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.762412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.762825 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.762827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.762957 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.763523 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:31.763535 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:31.765283 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:31.766957 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:31.766965 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:31.766967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:31.767305 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:31.767519 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:31.767520 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:31.767521 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:31.767669 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:31.767912 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:31.767918 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:31.768092 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 14:36:31.768222 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 14:36:31.768395 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":94,"threads_started":1}
I20260808 14:36:31.769152 32136 heartbeater.cc:347] Connected to a master server at 127.20.81.62:40811
I20260808 14:36:31.769237 32136 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:31.769436 32136 heartbeater.cc:511] Master 127.20.81.62:40811 requested a full tablet report, sending...
I20260808 14:36:31.769830 31785 ts_manager.cc:194] Registered new tserver with Master: 5acd5d1f60224a2095a737ef1eb5c3a2 (127.20.81.2:37847)
I20260808 14:36:31.770164 31785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:50983
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:36:31.787855 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:40811
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:31.869535 32142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:31.869730 32142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:31.869755 32142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:31.870944 32142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:31.870990 32142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:31.871047 32142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:36:31.872589 32142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:40811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:36:31.872846 32142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:31.873080 32142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:36:31.878008 32142 server_base.cc:1034] running on GCE node
W20260808 14:36:31.878010 32148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:31.878211 32150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:31.878010 32147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:31.878463 32142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:31.878712 32142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:31.879889 32142 hybrid_clock.cc:648] HybridClock initialized: now 1786199791879882 us; error 35 us; skew 500 ppm
Aug 08 14:36:31 dist-test-slave-8n49 krb5kdc[31738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:31.882422 32142 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:36:31.882844 32142 webserver.cc:460] Webserver started at http://127.20.81.3:37725/ using document root <none> and password file <none>
I20260808 14:36:31.883078 32142 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:31.883145 32142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:31.883301 32142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:31.884330 32142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "e884469834a049e7b91d0e1a231a9bec"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "6647a8d7a119e3eb19b36ca4f63abbc6"
server_key_iv: "e67ec202e344de5026f9d4d01e70edb2"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.884793 32142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "e884469834a049e7b91d0e1a231a9bec"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "6647a8d7a119e3eb19b36ca4f63abbc6"
server_key_iv: "e67ec202e344de5026f9d4d01e70edb2"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.886102 32142 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:36:31.886785 32157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.886960 32142 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:36:31.887058 32142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "e884469834a049e7b91d0e1a231a9bec"
format_stamp: "Formatted at 2026-08-08 14:36:31 on dist-test-slave-8n49"
server_key: "6647a8d7a119e3eb19b36ca4f63abbc6"
server_key_iv: "e67ec202e344de5026f9d4d01e70edb2"
server_key_version: "encryptionkey@0"
I20260808 14:36:31.887138 32142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:31.901294 32142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:31.903057 32142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:31.903214 32142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:31.903434 32142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:31.903736 32142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:31.903798 32142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.903838 32142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:31.903867 32142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:31.909786 32142 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:36903
I20260808 14:36:31.909847 32277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:36903 every 8 connection(s)
I20260808 14:36:31.910131 32142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:31.912883 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 32142
I20260808 14:36:31.913020 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:31.913262 20804 external_mini_cluster.cc:1428] Setting key 4c6d82fd8b33c9c13399468edc1091ec
Aug 08 14:36:31 dist-test-slave-8n49 krb5kdc[31738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:36:31.919713 31828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.910840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:34151 (local address 127.20.81.62:40811)
0808 14:36:31.910928 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.910930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.911115 (+ 185us) server_negotiation.cc:407] Connection header received
0808 14:36:31.911644 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.911646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.911660 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.911723 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:31.912900 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.913722 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.914946 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.915136 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.915201 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.917287 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:31.917288 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:31.917289 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:31.917295 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:31.918465 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.918832 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.918833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.918833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.918883 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.919140 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.919140 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.919141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.919241 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:31.919293 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.919589 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.919651 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:36:31.919900 32281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.910816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:40811 (local address 127.20.81.3:34151)
0808 14:36:31.910994 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:31.911035 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:31.911541 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:31.911789 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:31.911793 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:31.912353 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:31.912718 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.912726 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.913818 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.913819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.914849 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.914852 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.915215 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.915216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.915309 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.915758 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:31.915766 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:31.917204 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:31.918539 (+ 1335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:31.918545 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:31.918547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:31.918767 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:31.918961 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:31.918962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:31.918963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:31.919076 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:31.919324 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:31.919331 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:31.919451 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 14:36:31.919562 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:36:31.919682 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":81,"threads_started":1}
I20260808 14:36:31.920372 32279 heartbeater.cc:347] Connected to a master server at 127.20.81.62:40811
I20260808 14:36:31.920492 32279 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:31.920702 32279 heartbeater.cc:511] Master 127.20.81.62:40811 requested a full tablet report, sending...
I20260808 14:36:31.921115 31785 ts_manager.cc:194] Registered new tserver with Master: e884469834a049e7b91d0e1a231a9bec (127.20.81.3:36903)
I20260808 14:36:31.921487 31785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:34151
I20260808 14:36:31.925179 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:36:31.932478 31828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.926499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60510 (local address 127.20.81.62:40811)
0808 14:36:31.926609 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.926611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.926688 (+ 77us) server_negotiation.cc:407] Connection header received
0808 14:36:31.926767 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.926768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.926778 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.926850 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:31.927439 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.927906 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.928654 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.928844 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.928916 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.930027 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:31.930028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:31.930029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:31.930035 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:31.931289 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.931643 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.931644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.931645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.931706 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:31.931917 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:31.931918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:31.931918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:31.932070 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:31.932180 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.932284 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.932361 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:36:31.934527 31785 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60510:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:31.936170 31785 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:31.943190 32294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.939124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59692 (local address 127.20.81.3:36903)
0808 14:36:31.939523 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.939541 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.939552 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:36:31.939593 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.939596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.939611 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.939691 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:31.939819 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.940530 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.942123 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.942859 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.942936 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.942993 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.943095 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.943128 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":93,"threads_started":1}
I20260808 14:36:31.943181 32292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.938961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59958 (local address 127.20.81.2:37847)
0808 14:36:31.939217 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.939223 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.939233 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:31.939273 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.939276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.939291 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.939378 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:31.939686 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.940863 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.942171 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.942676 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.942780 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.942844 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.943044 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.943095 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":111,"threads_started":1}
I20260808 14:36:31.943226 32291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.938989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:36903 (local address 127.0.0.1:59692)
0808 14:36:31.939169 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:31.939181 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:31.939231 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:31.939699 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:31.939700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:31.939702 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:31.939749 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.939750 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.940694 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.940696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.942024 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.942027 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.942951 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.942952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.943021 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.943025 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:31.943083 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:36:31.943145 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":30,"thread_start_us":71,"threads_started":1}
I20260808 14:36:31.943413 32290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.938790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:37847 (local address 127.0.0.1:59958)
0808 14:36:31.938913 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:31.938958 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:31.939046 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:31.939512 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:31.939515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:31.939517 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:31.939600 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.939602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.940973 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.940975 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.942106 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.942108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.942797 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.942798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.942895 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.942914 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 14:36:31.943298 (+ 384us) client_negotiation.cc:240] Negotiation successful
0808 14:36:31.943347 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"mutex_wait_us":46,"thread_start_us":44,"threads_started":1}
I20260808 14:36:31.943861 32293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.939144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:43395 (local address 127.0.0.1:54064)
0808 14:36:31.939388 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:31.939397 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:31.939441 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:31.939790 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:31.939791 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:31.939794 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:31.939852 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.939855 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.941121 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.941122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.942030 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.942033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.943400 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.943401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.943466 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.943710 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 14:36:31.943761 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:36:31.943801 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":68,"threads_started":1}
I20260808 14:36:31.944150 32295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.939371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54064 (local address 127.20.81.1:43395)
0808 14:36:31.939576 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.939579 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.939589 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:31.939627 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.939628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.939644 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.939714 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:31.939939 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.941018 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.942162 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.942862 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.942936 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.942992 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.944018 (+ 1026us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.944070 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":88,"threads_started":1}
I20260808 14:36:31.944012 32207 tablet_service.cc:1467] Processing CreateTablet for tablet ca5a78e9608849458363a4950c49b999 (DEFAULT_TABLE table=test-table [id=026323dc5622441097ecb70fc2c95aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:31.944139 32064 tablet_service.cc:1467] Processing CreateTablet for tablet ca5a78e9608849458363a4950c49b999 (DEFAULT_TABLE table=test-table [id=026323dc5622441097ecb70fc2c95aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:31.944410 32207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca5a78e9608849458363a4950c49b999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:31.944490 32064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca5a78e9608849458363a4950c49b999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:31.945194 31919 tablet_service.cc:1467] Processing CreateTablet for tablet ca5a78e9608849458363a4950c49b999 (DEFAULT_TABLE table=test-table [id=026323dc5622441097ecb70fc2c95aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:31.945564 31919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca5a78e9608849458363a4950c49b999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:31.947000 32296 tablet_bootstrap.cc:492] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: Bootstrap starting.
I20260808 14:36:31.947562 32296 tablet_bootstrap.cc:654] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:31.947870 32297 tablet_bootstrap.cc:492] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: Bootstrap starting.
I20260808 14:36:31.948110 32296 log.cc:824] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:31.948521 32297 tablet_bootstrap.cc:654] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:31.949211 32297 log.cc:824] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:31.949252 32299 tablet_bootstrap.cc:492] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b: Bootstrap starting.
I20260808 14:36:31.949465 32296 tablet_bootstrap.cc:492] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: No bootstrap required, opened a new log
I20260808 14:36:31.949573 32296 ts_tablet_manager.cc:1397] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:36:31.949957 32299 tablet_bootstrap.cc:654] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:31.949968 32297 tablet_bootstrap.cc:492] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: No bootstrap required, opened a new log
I20260808 14:36:31.950037 32297 ts_tablet_manager.cc:1397] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:36:31.950548 32299 log.cc:824] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:31.951380 32299 tablet_bootstrap.cc:492] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b: No bootstrap required, opened a new log
I20260808 14:36:31.951453 32299 ts_tablet_manager.cc:1397] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:36:31.951347 32296 raft_consensus.cc:348] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } }
I20260808 14:36:31.951511 32296 raft_consensus.cc:374] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:31.951567 32296 raft_consensus.cc:729] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e884469834a049e7b91d0e1a231a9bec, State: Initialized, Role: FOLLOWER
I20260808 14:36:31.951723 32296 consensus_queue.cc:260] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } }
I20260808 14:36:31.952019 32296 ts_tablet_manager.cc:1428] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:36:31.952193 32279 heartbeater.cc:503] Master 127.20.81.62:40811 was elected leader, sending a full tablet report...
I20260808 14:36:31.952164 32297 raft_consensus.cc:348] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } }
I20260808 14:36:31.952316 32297 raft_consensus.cc:374] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:31.952353 32297 raft_consensus.cc:729] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5acd5d1f60224a2095a737ef1eb5c3a2, State: Initialized, Role: FOLLOWER
I20260808 14:36:31.952512 32297 consensus_queue.cc:260] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } }
I20260808 14:36:31.952832 32297 ts_tablet_manager.cc:1428] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 14:36:31.952855 32136 heartbeater.cc:503] Master 127.20.81.62:40811 was elected leader, sending a full tablet report...
I20260808 14:36:31.954051 32299 raft_consensus.cc:348] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } }
I20260808 14:36:31.954209 32299 raft_consensus.cc:374] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:31.954232 32299 raft_consensus.cc:729] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def56dbf9b1b4a5e8861d221b3c1450b, State: Initialized, Role: FOLLOWER
I20260808 14:36:31.954350 32299 consensus_queue.cc:260] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } }
I20260808 14:36:31.954602 32299 ts_tablet_manager.cc:1428] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:36:31.954672 31991 heartbeater.cc:503] Master 127.20.81.62:40811 was elected leader, sending a full tablet report...
I20260808 14:36:31.985044 32302 raft_consensus.cc:482] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:31.985176 32302 raft_consensus.cc:504] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } }
I20260808 14:36:31.985546 32302 leader_election.cc:288] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5acd5d1f60224a2095a737ef1eb5c3a2 (127.20.81.2:37847), def56dbf9b1b4a5e8861d221b3c1450b (127.20.81.1:43395)
I20260808 14:36:31.988464 32292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.985831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:46023 (local address 127.20.81.2:37847)
0808 14:36:31.985884 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.985886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.985896 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:31.985958 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.985959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.985971 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.986030 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:31.986249 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.986771 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.987723 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.988110 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.988195 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.988207 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.988351 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.988384 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:36:31.988492 32295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.986037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:45363 (local address 127.20.81.1:43395)
0808 14:36:31.986085 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.986087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.986097 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:36:31.986127 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.986128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.986141 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.986200 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:31.986347 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.986801 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.987750 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.988130 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.988227 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.988237 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:31.988380 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 14:36:31.988423 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:36:31.988503 32281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.985731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:37847 (local address 127.20.81.3:46023)
0808 14:36:31.985822 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:31.985836 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:31.985900 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:31.986088 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:31.986089 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:31.986091 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:31.986163 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.986165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.986859 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.986860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.987627 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.987629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.988195 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.988196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.988276 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.988279 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:36:31.988346 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:36:31.988384 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 14:36:31.988515 32305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.985846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:43395 (local address 127.20.81.3:45363)
0808 14:36:31.986024 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:31.986034 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:31.986080 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:31.986212 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:31.986212 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:31.986214 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:31.986275 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.986276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.986899 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.986900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.987652 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:31.987654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:31.988231 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:31.988233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:31.988303 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:31.988307 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:36:31.988374 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:36:31.988412 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":117,"threads_started":1}
I20260808 14:36:31.988909 32085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca5a78e9608849458363a4950c49b999" candidate_uuid: "e884469834a049e7b91d0e1a231a9bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" is_pre_election: true
I20260808 14:36:31.988991 31940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca5a78e9608849458363a4950c49b999" candidate_uuid: "e884469834a049e7b91d0e1a231a9bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" is_pre_election: true
I20260808 14:36:31.989107 32085 raft_consensus.cc:2454] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e884469834a049e7b91d0e1a231a9bec in term 0.
I20260808 14:36:31.989116 31940 raft_consensus.cc:2454] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e884469834a049e7b91d0e1a231a9bec in term 0.
I20260808 14:36:31.989338 32158 leader_election.cc:302] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5acd5d1f60224a2095a737ef1eb5c3a2, e884469834a049e7b91d0e1a231a9bec; no voters:
I20260808 14:36:31.989491 32302 raft_consensus.cc:2781] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:31.989566 32302 raft_consensus.cc:482] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:31.989583 32302 raft_consensus.cc:3037] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:31.990378 32302 raft_consensus.cc:504] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } }
I20260808 14:36:31.990522 32302 leader_election.cc:288] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [CANDIDATE]: Term 1 election: Requested vote from peers 5acd5d1f60224a2095a737ef1eb5c3a2 (127.20.81.2:37847), def56dbf9b1b4a5e8861d221b3c1450b (127.20.81.1:43395)
I20260808 14:36:31.990716 32085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca5a78e9608849458363a4950c49b999" candidate_uuid: "e884469834a049e7b91d0e1a231a9bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2"
I20260808 14:36:31.990796 32085 raft_consensus.cc:3037] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:31.990803 31940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca5a78e9608849458363a4950c49b999" candidate_uuid: "e884469834a049e7b91d0e1a231a9bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def56dbf9b1b4a5e8861d221b3c1450b"
I20260808 14:36:31.990886 31940 raft_consensus.cc:3037] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:31.991551 32085 raft_consensus.cc:2454] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e884469834a049e7b91d0e1a231a9bec in term 1.
I20260808 14:36:31.991700 31940 raft_consensus.cc:2454] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e884469834a049e7b91d0e1a231a9bec in term 1.
I20260808 14:36:31.991714 32158 leader_election.cc:302] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5acd5d1f60224a2095a737ef1eb5c3a2, e884469834a049e7b91d0e1a231a9bec; no voters:
I20260808 14:36:31.991941 32302 raft_consensus.cc:2781] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:31.992080 32302 raft_consensus.cc:686] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 1 LEADER]: Becoming Leader. State: Replica: e884469834a049e7b91d0e1a231a9bec, State: Running, Role: LEADER
I20260808 14:36:31.992174 32302 consensus_queue.cc:237] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } }
I20260808 14:36:31.992972 31786 catalog_manager.cc:5495] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec reported cstate change: term changed from 0 to 1, leader changed from <none> to e884469834a049e7b91d0e1a231a9bec (127.20.81.3). New cstate: current_term: 1 leader_uuid: "e884469834a049e7b91d0e1a231a9bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e884469834a049e7b91d0e1a231a9bec" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:32.001964 32294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:31.999753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59708 (local address 127.20.81.3:36903)
0808 14:36:31.999803 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:31.999805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:31.999812 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:36:31.999879 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:31.999880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:31.999896 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:31.999958 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:32.000062 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.000488 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.001258 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.001445 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.001500 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.001635 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:32.001725 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:32.001784 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.001824 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.001840 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:36:32.003646 31940 raft_consensus.cc:1261] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b [term 1 FOLLOWER]: Refusing update from remote peer e884469834a049e7b91d0e1a231a9bec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:32.003672 32085 raft_consensus.cc:1261] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [term 1 FOLLOWER]: Refusing update from remote peer e884469834a049e7b91d0e1a231a9bec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:32.003975 32302 consensus_queue.cc:1035] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "def56dbf9b1b4a5e8861d221b3c1450b" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:32.004136 32306 consensus_queue.cc:1035] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "5acd5d1f60224a2095a737ef1eb5c3a2" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:32.006397 32309 mvcc.cc:205] Tried to move back new op lower bound from 7316274348044603392 to 7316274348000604160. Current Snapshot: MvccSnapshot[applied={T|T < 7316274348044603392}]
I20260808 14:36:32.008955 31785 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:32.009057 31785 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:32.009826 31785 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a8c3afc1bfc64ff8938a7e6d88847866: Sending DeleteTablet for 3 replicas of tablet ca5a78e9608849458363a4950c49b999
I20260808 14:36:32.010203 32207 tablet_service.cc:1514] Processing DeleteTablet for tablet ca5a78e9608849458363a4950c49b999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:32 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:59692
I20260808 14:36:32.010197 32064 tablet_service.cc:1514] Processing DeleteTablet for tablet ca5a78e9608849458363a4950c49b999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:32 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:59958
I20260808 14:36:32.010262 31919 tablet_service.cc:1514] Processing DeleteTablet for tablet ca5a78e9608849458363a4950c49b999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:32 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:54064
I20260808 14:36:32.010473 32323 tablet_replica.cc:330] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b: stopping tablet replica
I20260808 14:36:32.010615 32323 raft_consensus.cc:2229] T ca5a78e9608849458363a4950c49b999 P def56dbf9b1b4a5e8861d221b3c1450b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:32.010684 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 31852
I20260808 14:36:32.015193 32322 tablet_replica.cc:330] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: stopping tablet replica
I20260808 14:36:32.015309 32322 raft_consensus.cc:2229] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:32.015407 32322 raft_consensus.cc:2258] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:32.015574 32321 tablet_replica.cc:330] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: stopping tablet replica
I20260808 14:36:32.015678 32321 raft_consensus.cc:2229] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:32.015796 32321 raft_consensus.cc:2258] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:32.017140 32322 ts_tablet_manager.cc:1905] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:32.017521 32321 ts_tablet_manager.cc:1905] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:32.019121 32321 ts_tablet_manager.cc:1918] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:32.019177 32322 ts_tablet_manager.cc:1918] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:32.019212 32321 log.cc:1196] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/ca5a78e9608849458363a4950c49b999
I20260808 14:36:32.019253 32322 log.cc:1196] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/ca5a78e9608849458363a4950c49b999
I20260808 14:36:32.019502 32321 ts_tablet_manager.cc:1939] T ca5a78e9608849458363a4950c49b999 P 5acd5d1f60224a2095a737ef1eb5c3a2: Deleting consensus metadata
I20260808 14:36:32.019565 32322 ts_tablet_manager.cc:1939] T ca5a78e9608849458363a4950c49b999 P e884469834a049e7b91d0e1a231a9bec: Deleting consensus metadata
I20260808 14:36:32.019930 31770 catalog_manager.cc:4841] TS 5acd5d1f60224a2095a737ef1eb5c3a2 (127.20.81.2:37847): tablet ca5a78e9608849458363a4950c49b999 (table test-table [id=026323dc5622441097ecb70fc2c95aac]) successfully deleted
I20260808 14:36:32.020681 31770 catalog_manager.cc:4841] TS e884469834a049e7b91d0e1a231a9bec (127.20.81.3:36903): tablet ca5a78e9608849458363a4950c49b999 (table test-table [id=026323dc5622441097ecb70fc2c95aac]) successfully deleted
W20260808 14:36:32.021771 31770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:43395 (error 108)
I20260808 14:36:32.021935 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 31996
I20260808 14:36:32.025678 32293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.025518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:43395 (local address 127.0.0.1:54078)
0808 14:36:32.025586 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:32.025640 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:43395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 14:36:32.025817 31770 catalog_manager.cc:4584] TS def56dbf9b1b4a5e8861d221b3c1450b (127.20.81.1:43395): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ca5a78e9608849458363a4950c49b999: Network error: Client connection negotiation failed: client connection to 127.20.81.1:43395: connect: Connection refused (error 111)
I20260808 14:36:32.028964 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 32142
I20260808 14:36:32.035950 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 31752
2026-08-08T14:36:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1984 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:32 dist-test-slave-8n49 krb5kdc[32327](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:32 dist-test-slave-8n49 krb5kdc[32327](info): set up 2 sockets
Aug 08 14:36:32 dist-test-slave-8n49 krb5kdc[32327](info): commencing operation
krb5kdc: starting...
W20260808 14:36:33.117478 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:36:33 dist-test-slave-8n49 krb5kdc[32327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199793, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:33Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.81.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.81.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/rangeradmin_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/rangeradmin_127.20.81.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.81.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.81.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/rangerlookup_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/rangerlookup_127.20.81.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.81.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.81.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/HTTP_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/HTTP_127.20.81.20@KRBTEST.COM.keytab.
I20260808 14:36:33.286994 20804 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskx904RQ/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/postgres -l logfile start
2026-08-08 14:36:35.818 UTC [32359] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:36:35.818 UTC [32359] LOG: listening on IPv4 address "127.20.81.20", port 37127
2026-08-08 14:36:35.822 UTC [32359] LOG: listening on Unix socket "/tmp/.s.PGSQL.37127"
2026-08-08 14:36:35.844 UTC [32362] LOG: database system was shut down at 2026-08-08 14:36:34 UTC
2026-08-08 14:36:35.847 UTC [32359] LOG: database system is ready to accept connections
I20260808 14:36:36.837800 20804 mini_postgres.cc:96] Postgres bound to 37127
2026-08-08 14:36:36.846 UTC [32371] FATAL: database "slave" does not exist
127.20.81.20:37127 - accepting connections
I20260808 14:36:36.846921 20804 mini_ranger.cc:161] Starting Ranger...
I20260808 14:36:36.863708 20804 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:36:37.356957 20804 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:36:37.357038 20804 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-admin
2026-08-08 14:36:37,677 [I] DB FLAVOR :POSTGRES
2026-08-08 14:36:37,677 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:36:37,677 [I] Checking connection..
2026-08-08 14:36:37,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:36:37,923 [I] Checking connection passed.
2026-08-08 14:36:37,923 [I] --------- Verifying version history table ---------
2026-08-08 14:36:37,924 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:36:38,191 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:36:38,192 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:36:38,440 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:36:38,441 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:36:38,441 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:36:38.670 UTC [32437] WARNING: there is no transaction in progress
2026-08-08 14:36:38,677 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:36:38,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:36:38,930 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:36:38,930 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:36:38,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:36:39,156 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:36:39,438 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8n49.c.gcp-upstream.internal','N') ;"
2026-08-08 14:36:39,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:36:39,931 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:36:39,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:36:40,193 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:36:40,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:36:40,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:36:40,704 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:36:40,704 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:36:41.641 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.657 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.674 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.689 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.708 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.728 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.792 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.798 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.811 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.821 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.830 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.844 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.854 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.860 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.867 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:41.873 UTC [32550] WARNING: there is no transaction in progress
2026-08-08 14:36:42,493 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:36:42,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:36:42,721 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:36:42,721 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:36:42,984 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:36:42,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:36:43,215 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:36:43,215 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:36:43,448 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:36:43,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8n49.c.gcp-upstream.internal';"
2026-08-08 14:36:43,952 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:36:43,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:36:44,176 [I] DB_PATCHES have already been applied
I20260808 14:36:44.182421 20804 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-admin:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskx904RQ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:36:44.182492 20804 mini_ranger.cc:193] Using host: 127.20.81.20
I20260808 14:36:44.186167 20804 mini_ranger.cc:227] Ranger admin URL: http://127.20.81.20:37095
Aug 08, 2026 2:36:44 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:36:44 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:36:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:36:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:36:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:36:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:36:45 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:36:45.427832 20804 mini_ranger.cc:160] Time spent starting Ranger: real 8.581s user 0.002s sys 0.008s
Aug 08, 2026 2:37:06 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:37:06 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 08, 2026 2:37:06 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:37:06 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:37:07 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:37:07.579885 20804 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.81.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.81.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/rangerkms_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/rangerkms_127.20.81.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.81.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.81.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.81.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/HTTP_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.81.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/HTTP_127.20.81.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:37:07 dist-test-slave-8n49 krb5kdc[32327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199827, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:37:07.681650 20804 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:37:07.691887 20804 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:37:08.558753 20804 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:37:08.558848 20804 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-kms
I20260808 14:37:08.558866 20804 mini_ranger_kms.cc:227] Using postgres at 127.20.81.20:37127
2026-08-08 14:37:08,951 [I] DB FLAVOR :POSTGRES
2026-08-08 14:37:08,951 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:37:08,951 [I] Checking connection
2026-08-08 14:37:08,951 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:37:09,190 [I] connection success
2026-08-08 14:37:09,190 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:37:09,190 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:37:09,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:37:09,438 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:37:09,439 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:37:09,439 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:37:09,439 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:37127/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:37:09,730 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:37:10.216276 20804 mini_ranger_kms.cc:310] Created kms service
I20260808 14:37:10.435689 20804 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:37:10.483670 20804 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:37:10 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199827, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:37:10.909605 20804 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:37:10.909732 20804 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-kms:/tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:37:10.909755 20804 mini_ranger_kms.cc:240] Using host: 127.20.81.20
I20260808 14:37:10.914775 20804 mini_ranger_kms.cc:276] Ranger KMS PID: 32741
I20260808 14:37:10.914891 20804 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.81.20:45915
Aug 08, 2026 2:37:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:37:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:37:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:37:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:37:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:37:12 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 14:37:13.286921 20804 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.605s user 0.000s sys 0.269s
I20260808 14:37:13.287041 20804 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:37:13.287169 20804 mini_ranger_kms.cc:401] 127.20.81.20:45915/kms/v1/keys
Aug 08 14:37:13 dist-test-slave-8n49 krb5kdc[32327](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199833, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.81.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 14:37:13 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199833, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.81.20@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
Aug 08 14:37:14 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199833, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.81.20@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
Aug 08 14:37:16 dist-test-slave-8n49 krb5kdc[32327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:37:16.551858 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:46099
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:44669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:46099
--ranger_config_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:45915/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:16.637123 327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:16.637368 327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:16.637409 327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:16.638602 327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:37:16.638672 327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:16.638697 327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:16.638724 327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:37:16.638756 327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:37:16.640442 327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:44669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.81.20:45915/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:46099
--ranger_config_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:46099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:37:16.640758 327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:16.640996 327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:16.646271 332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:16.646273 327 server_base.cc:1034] running on GCE node
W20260808 14:37:16.646404 333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:16.646286 335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:16.646797 327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:16.647122 327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:16.648308 327 hybrid_clock.cc:648] HybridClock initialized: now 1786199836648297 us; error 30 us; skew 500 ppm
Aug 08 14:37:16 dist-test-slave-8n49 krb5kdc[32327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199836, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:16.654146 327 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:37:16.654712 327 webserver.cc:460] Webserver started at http://127.20.81.62:43161/ using document root <none> and password file <none>
I20260808 14:37:16.654991 327 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:16.655035 327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:16.655179 327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:37:16 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199836, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:37:16.701843 327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "e5eaddc0986b42599724643897734e55"
format_stamp: "Formatted at 2026-08-08 14:37:16 on dist-test-slave-8n49"
server_key: "47530662a3e07aeb732a30e0a1485cc4"
server_key_iv: "f4f9f4094ef9ec2da0be5e43e7c698c9"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:16.702360 327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "e5eaddc0986b42599724643897734e55"
format_stamp: "Formatted at 2026-08-08 14:37:16 on dist-test-slave-8n49"
server_key: "47530662a3e07aeb732a30e0a1485cc4"
server_key_iv: "f4f9f4094ef9ec2da0be5e43e7c698c9"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:16.703928 327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:37:16.718705 343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:16.718984 327 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:37:16.719105 327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "e5eaddc0986b42599724643897734e55"
format_stamp: "Formatted at 2026-08-08 14:37:16 on dist-test-slave-8n49"
server_key: "47530662a3e07aeb732a30e0a1485cc4"
server_key_iv: "f4f9f4094ef9ec2da0be5e43e7c698c9"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:16.719220 327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:16.747639 327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:16.749716 327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:16.749868 327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:16.754990 327 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:46099
I20260808 14:37:16.755026 399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:46099 every 8 connection(s)
I20260808 14:37:16.755417 327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:37:16.756145 400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:16.758564 400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55: Bootstrap starting.
I20260808 14:37:16.758890 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 327
I20260808 14:37:16.758997 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:37:16.759222 20804 external_mini_cluster.cc:1428] Setting key 6d792c4889ca50c159001aca8b6276ee
I20260808 14:37:16.760130 400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:16.760524 400 log.cc:824] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:16.761564 400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55: No bootstrap required, opened a new log
I20260808 14:37:16.764588 400 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eaddc0986b42599724643897734e55" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46099 } }
I20260808 14:37:16.764820 400 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:16.764883 400 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5eaddc0986b42599724643897734e55, State: Initialized, Role: FOLLOWER
I20260808 14:37:16.765044 400 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eaddc0986b42599724643897734e55" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46099 } }
I20260808 14:37:16.765158 400 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:37:16.765213 400 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:37:16.765278 400 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 14:37:16 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:37:16.766158 400 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eaddc0986b42599724643897734e55" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46099 } }
I20260808 14:37:16.766319 400 leader_election.cc:302] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5eaddc0986b42599724643897734e55; no voters:
I20260808 14:37:16.766505 400 leader_election.cc:288] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:37:16.766553 405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:16.766842 405 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [term 1 LEADER]: Becoming Leader. State: Replica: e5eaddc0986b42599724643897734e55, State: Running, Role: LEADER
I20260808 14:37:16.766897 400 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:37:16.767010 405 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eaddc0986b42599724643897734e55" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46099 } }
I20260808 14:37:16.767383 405 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5eaddc0986b42599724643897734e55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eaddc0986b42599724643897734e55" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46099 } } }
I20260808 14:37:16.767469 405 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:16.767606 405 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5eaddc0986b42599724643897734e55. Latest consensus state: current_term: 1 leader_uuid: "e5eaddc0986b42599724643897734e55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eaddc0986b42599724643897734e55" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 46099 } } }
I20260808 14:37:16.767673 405 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:16.767802 409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:37:16.768386 409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:37:16.768945 400 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:37:16.770664 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:16.759816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49534 (local address 127.20.81.62:46099)
0808 14:37:16.760069 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:16.760079 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:16.760118 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:37:16.760694 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:16.760705 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:16.760771 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:16.760923 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:16.761714 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:16.762631 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:16.763473 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:16.763907 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:16.764042 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:16.766731 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:16.766736 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:16.766736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:16.766751 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:16.768860 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:16.769301 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:16.769303 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:16.769303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:16.769397 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:16.769647 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:16.769647 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:16.769648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:16.769967 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:16.770121 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:16.770328 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 14:37:16.770451 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":149,"threads_started":1}
I20260808 14:37:16.781383 409 catalog_manager.cc:1347] Generated new cluster ID: 374c0198096f461d9c87be7782738bd3
I20260808 14:37:16.781595 409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:37:16.790696 409 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:37:16.791527 409 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:37:16.814272 409 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55: Generated new TSK 0
I20260808 14:37:16.814639 409 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:37:17.539844 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:45915/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46099
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:44669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:17.656001 448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:17.656208 448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:17.656230 448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:17.658063 448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:17.658128 448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:17.658169 448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:37:17.660315 448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:44669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.81.20:45915/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:37:17.660559 448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:17.660867 448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:17.665958 453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:17.666126 454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:17.665972 456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:17.666354 448 server_base.cc:1034] running on GCE node
I20260808 14:37:17.666637 448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:17.666901 448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:17.668093 448 hybrid_clock.cc:648] HybridClock initialized: now 1786199837668074 us; error 35 us; skew 500 ppm
Aug 08 14:37:17 dist-test-slave-8n49 krb5kdc[32327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199837, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:17.671096 448 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:37:17.671618 448 webserver.cc:460] Webserver started at http://127.20.81.1:40065/ using document root <none> and password file <none>
I20260808 14:37:17.671859 448 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:17.671928 448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:17.672071 448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:37:17 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199837, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:37:17.686134 448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "2603f78d10e149d88b1c15685e4bb78c"
format_stamp: "Formatted at 2026-08-08 14:37:17 on dist-test-slave-8n49"
server_key: "55b1601d520110229add5f8a17a79c26"
server_key_iv: "8ed6e9723fbd3be5a2aae00ba85cce60"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:17.686605 448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "2603f78d10e149d88b1c15685e4bb78c"
format_stamp: "Formatted at 2026-08-08 14:37:17 on dist-test-slave-8n49"
server_key: "55b1601d520110229add5f8a17a79c26"
server_key_iv: "8ed6e9723fbd3be5a2aae00ba85cce60"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:17.688966 448 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 14:37:17.708196 465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:17.708588 448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:37:17.708772 448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "2603f78d10e149d88b1c15685e4bb78c"
format_stamp: "Formatted at 2026-08-08 14:37:17 on dist-test-slave-8n49"
server_key: "55b1601d520110229add5f8a17a79c26"
server_key_iv: "8ed6e9723fbd3be5a2aae00ba85cce60"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:17.708945 448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:17.729522 448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:17.732005 448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:17.732213 448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:17.732575 448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:17.733014 448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:17.733104 448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:17.733204 448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:17.733280 448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:17.739673 448 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:43673
I20260808 14:37:17.740145 448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:37:17.743218 582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:43673 every 8 connection(s)
I20260808 14:37:17.746894 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 448
I20260808 14:37:17.747013 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:37:17.747237 20804 external_mini_cluster.cc:1428] Setting key 7f9b4a37782b3a08b0f775a03d8db60c
Aug 08 14:37:17 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199837, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:37:17.756062 585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:17.743950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46099 (local address 127.20.81.1:57683)
0808 14:37:17.744169 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:17.744225 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:17.744960 (+ 735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:17.746264 (+ 1304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:17.746270 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:17.746583 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:17.746897 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:17.746904 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:17.748013 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:17.748015 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:17.749335 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:17.749338 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:17.749891 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:17.749892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:17.750040 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:17.750652 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:17.750663 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:17.752275 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:17.754339 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:17.754346 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:17.754349 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:17.754647 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:17.754945 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:17.754946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:17.754946 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:17.755078 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:17.755380 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:17.755386 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:17.755564 (+ 178us) client_negotiation.cc:769] Sending connection context
0808 14:37:17.755670 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:37:17.755824 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":103,"threads_started":1}
I20260808 14:37:17.756883 586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:17.743995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:57683 (local address 127.20.81.62:46099)
0808 14:37:17.745998 (+ 2003us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:17.746001 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:17.746011 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:37:17.746042 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:17.746043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:17.746058 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:17.747007 (+ 949us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:17.747060 (+ 53us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:17.747852 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:17.749442 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:17.749781 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:17.751291 (+ 1510us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:17.752384 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:17.752385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:17.752386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:17.752405 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:17.754240 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:17.754743 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:17.754744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:17.754744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:17.754808 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:17.755159 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:17.755160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:17.755160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:17.755299 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:17.756653 (+ 1354us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:17.756698 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 14:37:17.756786 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1965,"thread_start_us":76,"threads_started":1}
I20260808 14:37:17.757476 583 heartbeater.cc:347] Connected to a master server at 127.20.81.62:46099
I20260808 14:37:17.757606 583 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:17.757827 583 heartbeater.cc:511] Master 127.20.81.62:46099 requested a full tablet report, sending...
I20260808 14:37:17.758383 361 ts_manager.cc:194] Registered new tserver with Master: 2603f78d10e149d88b1c15685e4bb78c (127.20.81.1:43673)
I20260808 14:37:17.759263 361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:57683
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:37:17.812315 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:45915/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46099
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:44669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:37:17 dist-test-slave-8n49 krb5kdc[32327](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199837, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:37:17.942659 591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:17.943023 591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:17.943106 591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:17.944882 591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:17.944995 591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:17.945079 591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:37:17.947371 591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:44669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.81.20:45915/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:37:17.947842 591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:17.948158 591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:17.954517 599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:17.954530 598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:17.954691 601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:17.955581 591 server_base.cc:1034] running on GCE node
I20260808 14:37:17.955790 591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:17.956043 591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:17.959290 591 hybrid_clock.cc:648] HybridClock initialized: now 1786199837959253 us; error 47 us; skew 500 ppm
Aug 08 14:37:17 dist-test-slave-8n49 krb5kdc[32327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199837, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:17.962751 591 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:37:17.963297 591 webserver.cc:460] Webserver started at http://127.20.81.2:37933/ using document root <none> and password file <none>
I20260808 14:37:17.963647 591 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:17.963755 591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:17.964123 591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:37:17 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199837, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:37:17.977028 591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "765ed642b18347068e0805fcc55cbbdb"
format_stamp: "Formatted at 2026-08-08 14:37:17 on dist-test-slave-8n49"
server_key: "9eb919d20c4ef9718e0b8c108ca54b5e"
server_key_iv: "b7271b5fd95867d07054c9efbf30f78f"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:17.980592 591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "765ed642b18347068e0805fcc55cbbdb"
format_stamp: "Formatted at 2026-08-08 14:37:17 on dist-test-slave-8n49"
server_key: "9eb919d20c4ef9718e0b8c108ca54b5e"
server_key_iv: "b7271b5fd95867d07054c9efbf30f78f"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:17.982192 591 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:37:17.997303 608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:17.997522 591 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.000s
I20260808 14:37:17.997603 591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "765ed642b18347068e0805fcc55cbbdb"
format_stamp: "Formatted at 2026-08-08 14:37:17 on dist-test-slave-8n49"
server_key: "9eb919d20c4ef9718e0b8c108ca54b5e"
server_key_iv: "b7271b5fd95867d07054c9efbf30f78f"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:17.997689 591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:18.013521 591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:18.015847 591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:18.015956 591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:18.016268 591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:18.016680 591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:18.016731 591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:18.016752 591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:18.016765 591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:18.024720 591 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:32785
I20260808 14:37:18.025279 591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:37:18.027472 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 591
I20260808 14:37:18.027601 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:37:18.027742 724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:32785 every 8 connection(s)
I20260808 14:37:18.027801 20804 external_mini_cluster.cc:1428] Setting key b49333f82664d35ba421a63aa68f6174
Aug 08 14:37:18 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199837, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:37:18.040762 586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.028661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:32977 (local address 127.20.81.62:46099)
0808 14:37:18.030491 (+ 1830us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:18.030494 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:18.030504 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:37:18.030531 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:18.030531 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:18.030543 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:18.030601 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:18.031502 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.032294 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.033971 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.034369 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.034420 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.037285 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:18.037287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:18.037288 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:18.037296 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:18.039030 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:18.039542 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:18.039543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:18.039544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:18.039603 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:18.039911 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:18.039912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:18.039912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:18.040050 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:18.040117 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:18.040512 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 14:37:18.040666 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1797}
I20260808 14:37:18.041503 727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.028511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46099 (local address 127.20.81.2:32977)
0808 14:37:18.028930 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:18.028973 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:18.029709 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:18.030742 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:18.030748 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:18.031014 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:18.031373 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.031380 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.032436 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.032437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.033860 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.033864 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.034522 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.034523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.034694 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.035337 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:18.035348 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:18.037165 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:18.039146 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:18.039154 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:18.039157 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:18.039446 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:18.039687 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:18.039688 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:18.039688 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:18.039820 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:18.040155 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:18.040162 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:18.040336 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 14:37:18.041090 (+ 754us) client_negotiation.cc:240] Negotiation successful
0808 14:37:18.041268 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":230,"threads_started":1}
I20260808 14:37:18.042335 725 heartbeater.cc:347] Connected to a master server at 127.20.81.62:46099
I20260808 14:37:18.042510 725 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:18.042707 725 heartbeater.cc:511] Master 127.20.81.62:46099 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
I20260808 14:37:18.043196 361 ts_manager.cc:194] Registered new tserver with Master: 765ed642b18347068e0805fcc55cbbdb (127.20.81.2:32785)
I20260808 14:37:18.043664 361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:32977
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:37:18.062101 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:45915/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46099
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:44669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:18.168720 730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:18.169041 730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:18.169095 730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:18.170776 730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:18.170840 730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:18.170877 730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:37:18.173079 730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:44669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.81.20:45915/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:46099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:37:18.173338 730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:18.173671 730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:18.180190 736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:18.180469 738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:18.180589 735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:18.181632 730 server_base.cc:1034] running on GCE node
I20260808 14:37:18.181857 730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:18.182149 730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:18.183319 730 hybrid_clock.cc:648] HybridClock initialized: now 1786199838183296 us; error 34 us; skew 500 ppm
Aug 08 14:37:18 dist-test-slave-8n49 krb5kdc[32327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199838, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:18.186640 730 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:37:18.187160 730 webserver.cc:460] Webserver started at http://127.20.81.3:42561/ using document root <none> and password file <none>
I20260808 14:37:18.187448 730 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:18.187513 730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:18.187655 730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:37:18 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199838, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:37:18.206497 730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "0d6c4c010fc04a59b8af7f516da83f98"
format_stamp: "Formatted at 2026-08-08 14:37:18 on dist-test-slave-8n49"
server_key: "c0853339fd97bee7435849e87863e5d5"
server_key_iv: "01c899440784e03ce7f21a310069a4c8"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:18.207147 730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "0d6c4c010fc04a59b8af7f516da83f98"
format_stamp: "Formatted at 2026-08-08 14:37:18 on dist-test-slave-8n49"
server_key: "c0853339fd97bee7435849e87863e5d5"
server_key_iv: "01c899440784e03ce7f21a310069a4c8"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:18.209566 730 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:37:18.225780 745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:18.226029 730 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 14:37:18.226148 730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "0d6c4c010fc04a59b8af7f516da83f98"
format_stamp: "Formatted at 2026-08-08 14:37:18 on dist-test-slave-8n49"
server_key: "c0853339fd97bee7435849e87863e5d5"
server_key_iv: "01c899440784e03ce7f21a310069a4c8"
server_key_version: "kuduclusterkey@0"
I20260808 14:37:18.226251 730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:18.263724 730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:18.270300 730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:18.270542 730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:18.270866 730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:18.271325 730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:18.271438 730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:18.271520 730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:18.271597 730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:18.279476 730 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:41251
I20260808 14:37:18.280010 730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:37:18.284907 862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:41251 every 8 connection(s)
I20260808 14:37:18.288857 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 730
I20260808 14:37:18.288969 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:37:18.289203 20804 external_mini_cluster.cc:1428] Setting key eaaf1913d7bd94cd697263c25249cfff
Aug 08 14:37:18 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199838, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:37:18.301998 586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.285895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:41285 (local address 127.20.81.62:46099)
0808 14:37:18.285940 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:18.285942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:18.289438 (+ 3496us) server_negotiation.cc:407] Connection header received
0808 14:37:18.290775 (+ 1337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:18.290776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:18.290789 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:18.290823 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:18.291699 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.292547 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.294634 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.294943 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.294986 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.298098 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:18.298100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:18.298100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:18.298108 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:18.299792 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:18.300667 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:18.300668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:18.300669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:18.300734 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:18.301025 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:18.301026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:18.301027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:18.301174 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:18.301227 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:18.301807 (+ 580us) server_negotiation.cc:299] Negotiation successful
0808 14:37:18.301895 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:37:18.302798 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.285574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:46099 (local address 127.20.81.3:41285)
0808 14:37:18.289230 (+ 3656us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:18.289340 (+ 110us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:18.290650 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:18.291021 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:18.291026 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:18.291278 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:18.291571 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.291578 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.292688 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.292689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.294524 (+ 1835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.294528 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.295094 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.295095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.295241 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.295794 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:18.295806 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:18.297968 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:18.300248 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:18.300255 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:18.300258 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:18.300544 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:18.300813 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:18.300814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:18.300814 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:18.300950 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:18.301262 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:18.301269 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:18.301450 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 14:37:18.302380 (+ 930us) client_negotiation.cc:240] Negotiation successful
0808 14:37:18.302556 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3609,"thread_start_us":118,"threads_started":1}
I20260808 14:37:18.303434 863 heartbeater.cc:347] Connected to a master server at 127.20.81.62:46099
I20260808 14:37:18.303529 863 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:18.303717 863 heartbeater.cc:511] Master 127.20.81.62:46099 requested a full tablet report, sending...
I20260808 14:37:18.304121 361 ts_manager.cc:194] Registered new tserver with Master: 0d6c4c010fc04a59b8af7f516da83f98 (127.20.81.3:41251)
I20260808 14:37:18.304678 361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:41285
Aug 08 14:37:18 dist-test-slave-8n49 krb5kdc[32327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199837, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:37:18.311483 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:37:18.328025 586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.319389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49544 (local address 127.20.81.62:46099)
0808 14:37:18.319441 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:18.319443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:18.319762 (+ 319us) server_negotiation.cc:407] Connection header received
0808 14:37:18.319866 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:18.319868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:18.319879 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:18.319909 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:18.320765 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.321548 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.322743 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.323060 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.323109 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.324835 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:18.324836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:18.324837 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:18.324844 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:18.326743 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:18.327167 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:18.327168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:18.327168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:18.327226 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:18.327425 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:18.327426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:18.327426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:18.327558 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:18.327632 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:18.327848 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 14:37:18.327927 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:37:18.330343 361 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:37:18.332768 361 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:37:18.351917 877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.336252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:43673 (local address 127.0.0.1:42482)
0808 14:37:18.337936 (+ 1684us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:18.337976 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:18.338038 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:18.339070 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:18.339071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:18.339073 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:18.339129 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.339131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.346950 (+ 7819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.346951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.348404 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.348406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.351545 (+ 3139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.351546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.351660 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.351677 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 14:37:18.351757 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:37:18.351819 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1650,"thread_start_us":79,"threads_started":1}
I20260808 14:37:18.352860 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.336501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:32785 (local address 127.0.0.1:51078)
0808 14:37:18.338503 (+ 2002us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:18.338513 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:18.338563 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:18.338914 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:18.338917 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:18.338919 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:18.338986 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.338988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.341016 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.341017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.346642 (+ 5625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.346644 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.352615 (+ 5971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.352617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.352686 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.352690 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:37:18.352742 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:37:18.352784 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1987,"thread_start_us":96,"threads_started":1}
I20260808 14:37:18.353145 876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.337272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:41251 (local address 127.0.0.1:54346)
0808 14:37:18.342070 (+ 4798us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:18.342080 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:18.342127 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:18.342395 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:18.342396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:18.342398 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:18.342436 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.342437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.344816 (+ 2379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.344817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.345964 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.345967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.352918 (+ 6951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.352919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.352978 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.352982 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:37:18.353030 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 14:37:18.353084 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4781,"thread_start_us":75,"threads_started":1}
I20260808 14:37:18.354076 881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.337486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54346 (local address 127.20.81.3:41251)
0808 14:37:18.338678 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:18.338682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:18.342187 (+ 3505us) server_negotiation.cc:407] Connection header received
0808 14:37:18.342233 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:18.342235 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:18.342251 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:18.342317 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:18.342503 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.343610 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.348518 (+ 4908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.349322 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.349399 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.349491 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:18.353920 (+ 4429us) server_negotiation.cc:299] Negotiation successful
0808 14:37:18.353979 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1157,"thread_start_us":73,"threads_started":1}
I20260808 14:37:18.354416 878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.336856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42482 (local address 127.20.81.1:43673)
0808 14:37:18.338187 (+ 1331us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:18.338192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:18.338202 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:37:18.338240 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:18.338242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:18.338258 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:18.338326 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:18.339203 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.346864 (+ 7661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.350570 (+ 3706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.351375 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.351451 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.351505 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:18.354293 (+ 2788us) server_negotiation.cc:299] Negotiation successful
0808 14:37:18.354347 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1294,"thread_start_us":55,"threads_started":1}
I20260808 14:37:18.354739 879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.336998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51078 (local address 127.20.81.2:32785)
0808 14:37:18.338451 (+ 1453us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:18.338455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:18.338701 (+ 246us) server_negotiation.cc:407] Connection header received
0808 14:37:18.338743 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:18.338745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:18.338761 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:18.338827 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:18.339749 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.340918 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.349559 (+ 8641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.350369 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.350446 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.350525 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:18.354609 (+ 4084us) server_negotiation.cc:299] Negotiation successful
0808 14:37:18.354658 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1418,"thread_start_us":92,"threads_started":1}
I20260808 14:37:18.356349 795 tablet_service.cc:1467] Processing CreateTablet for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88 (DEFAULT_TABLE table=test-table [id=d02aad8b3bba4c919bb075a2de3b562f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:18.357066 795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:18.358831 514 tablet_service.cc:1467] Processing CreateTablet for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88 (DEFAULT_TABLE table=test-table [id=d02aad8b3bba4c919bb075a2de3b562f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:18.359195 514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:18.362531 656 tablet_service.cc:1467] Processing CreateTablet for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88 (DEFAULT_TABLE table=test-table [id=d02aad8b3bba4c919bb075a2de3b562f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:18.362879 656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:18.367013 882 tablet_bootstrap.cc:492] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: Bootstrap starting.
I20260808 14:37:18.368186 882 tablet_bootstrap.cc:654] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:18.368404 884 tablet_bootstrap.cc:492] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: Bootstrap starting.
I20260808 14:37:18.369514 884 tablet_bootstrap.cc:654] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:18.369907 882 log.cc:824] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:18.370141 883 tablet_bootstrap.cc:492] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c: Bootstrap starting.
I20260808 14:37:18.371064 883 tablet_bootstrap.cc:654] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:18.371454 884 log.cc:824] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:18.371994 883 log.cc:824] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:18.372869 882 tablet_bootstrap.cc:492] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: No bootstrap required, opened a new log
I20260808 14:37:18.372989 882 ts_tablet_manager.cc:1397] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 14:37:18.375507 882 raft_consensus.cc:348] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } }
I20260808 14:37:18.375800 882 raft_consensus.cc:374] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:18.375890 882 raft_consensus.cc:729] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6c4c010fc04a59b8af7f516da83f98, State: Initialized, Role: FOLLOWER
I20260808 14:37:18.376101 882 consensus_queue.cc:260] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } }
I20260808 14:37:18.376452 882 ts_tablet_manager.cc:1428] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:37:18.376643 863 heartbeater.cc:503] Master 127.20.81.62:46099 was elected leader, sending a full tablet report...
I20260808 14:37:18.378141 884 tablet_bootstrap.cc:492] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: No bootstrap required, opened a new log
I20260808 14:37:18.378262 884 ts_tablet_manager.cc:1397] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260808 14:37:18.380354 884 raft_consensus.cc:348] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } }
I20260808 14:37:18.380622 884 raft_consensus.cc:374] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:18.380716 884 raft_consensus.cc:729] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765ed642b18347068e0805fcc55cbbdb, State: Initialized, Role: FOLLOWER
I20260808 14:37:18.380903 884 consensus_queue.cc:260] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } }
I20260808 14:37:18.381243 884 ts_tablet_manager.cc:1428] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:18.381402 725 heartbeater.cc:503] Master 127.20.81.62:46099 was elected leader, sending a full tablet report...
I20260808 14:37:18.382449 883 tablet_bootstrap.cc:492] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c: No bootstrap required, opened a new log
I20260808 14:37:18.382581 883 ts_tablet_manager.cc:1397] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260808 14:37:18.385655 883 raft_consensus.cc:348] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } }
I20260808 14:37:18.385874 883 raft_consensus.cc:374] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:18.385950 883 raft_consensus.cc:729] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2603f78d10e149d88b1c15685e4bb78c, State: Initialized, Role: FOLLOWER
I20260808 14:37:18.386139 883 consensus_queue.cc:260] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } }
I20260808 14:37:18.386463 883 ts_tablet_manager.cc:1428] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 14:37:18.386627 583 heartbeater.cc:503] Master 127.20.81.62:46099 was elected leader, sending a full tablet report...
W20260808 14:37:18.494294 584 tablet.cc:2369] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:37:18.516708 889 raft_consensus.cc:482] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:18.516860 889 raft_consensus.cc:504] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } }
I20260808 14:37:18.517297 889 leader_election.cc:288] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2603f78d10e149d88b1c15685e4bb78c (127.20.81.1:43673), 0d6c4c010fc04a59b8af7f516da83f98 (127.20.81.3:41251)
I20260808 14:37:18.522152 727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.517544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:43673 (local address 127.20.81.2:55303)
0808 14:37:18.517647 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:18.517660 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:18.517705 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:18.518208 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:18.518209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:18.518212 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:18.518289 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.518292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.519828 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.519829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.521075 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.521077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.521877 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.521878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.521953 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.521957 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:37:18.522001 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:37:18.522072 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 14:37:18.522915 878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.517814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:55303 (local address 127.20.81.1:43673)
0808 14:37:18.517857 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:18.517859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:18.517867 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:37:18.517898 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:18.517898 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:18.517908 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:18.517973 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:18.518801 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.519580 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.521190 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.521764 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.521832 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.521843 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:18.522803 (+ 960us) server_negotiation.cc:299] Negotiation successful
0808 14:37:18.522849 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:37:18.523206 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8a54aaf0ad47cd9a1fdf16a0b42d88" candidate_uuid: "765ed642b18347068e0805fcc55cbbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2603f78d10e149d88b1c15685e4bb78c" is_pre_election: true
I20260808 14:37:18.523362 532 raft_consensus.cc:2454] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765ed642b18347068e0805fcc55cbbdb in term 0.
I20260808 14:37:18.523825 610 leader_election.cc:302] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2603f78d10e149d88b1c15685e4bb78c, 765ed642b18347068e0805fcc55cbbdb; no voters:
I20260808 14:37:18.524122 889 raft_consensus.cc:2781] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:37:18.524180 889 raft_consensus.cc:482] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:37:18.524202 889 raft_consensus.cc:3037] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:18.525142 889 raft_consensus.cc:504] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } }
I20260808 14:37:18.525275 889 leader_election.cc:288] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [CANDIDATE]: Term 1 election: Requested vote from peers 2603f78d10e149d88b1c15685e4bb78c (127.20.81.1:43673), 0d6c4c010fc04a59b8af7f516da83f98 (127.20.81.3:41251)
I20260808 14:37:18.525570 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8a54aaf0ad47cd9a1fdf16a0b42d88" candidate_uuid: "765ed642b18347068e0805fcc55cbbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2603f78d10e149d88b1c15685e4bb78c"
I20260808 14:37:18.525645 532 raft_consensus.cc:3037] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:18.526517 532 raft_consensus.cc:2454] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765ed642b18347068e0805fcc55cbbdb in term 1.
I20260808 14:37:18.526714 610 leader_election.cc:302] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2603f78d10e149d88b1c15685e4bb78c, 765ed642b18347068e0805fcc55cbbdb; no voters:
I20260808 14:37:18.526835 889 raft_consensus.cc:2781] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:18.526983 889 raft_consensus.cc:686] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 1 LEADER]: Becoming Leader. State: Replica: 765ed642b18347068e0805fcc55cbbdb, State: Running, Role: LEADER
I20260808 14:37:18.527076 889 consensus_queue.cc:237] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } }
I20260808 14:37:18.527899 361 catalog_manager.cc:5495] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb reported cstate change: term changed from 0 to 1, leader changed from <none> to 765ed642b18347068e0805fcc55cbbdb (127.20.81.2). New cstate: current_term: 1 leader_uuid: "765ed642b18347068e0805fcc55cbbdb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765ed642b18347068e0805fcc55cbbdb" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 32785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 } health_report { overall_health: UNKNOWN } } }
W20260808 14:37:18.528472 726 tablet.cc:2369] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:37:18.532424 727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.518568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:41251 (local address 127.20.81.2:36003)
0808 14:37:18.522224 (+ 3656us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:18.522235 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:18.522272 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:18.529223 (+ 6951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:18.529224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:18.529226 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:18.529266 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.529267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.530259 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.530260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.531400 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:18.531403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.532182 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.532183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:18.532243 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.532246 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:37:18.532290 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:37:18.532324 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3646,"thread_start_us":62,"threads_started":1}
I20260808 14:37:18.532763 881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.518726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:36003 (local address 127.20.81.3:41251)
0808 14:37:18.518764 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:18.518766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:18.522352 (+ 3586us) server_negotiation.cc:407] Connection header received
0808 14:37:18.522384 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:18.522385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:18.522397 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:18.522447 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:18.529369 (+ 6922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.530119 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.531496 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.532066 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.532136 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.532148 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:18.532649 (+ 501us) server_negotiation.cc:299] Negotiation successful
0808 14:37:18.532699 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:37:18.533310 815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8a54aaf0ad47cd9a1fdf16a0b42d88" candidate_uuid: "765ed642b18347068e0805fcc55cbbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6c4c010fc04a59b8af7f516da83f98" is_pre_election: true
I20260808 14:37:18.533497 815 raft_consensus.cc:2454] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765ed642b18347068e0805fcc55cbbdb in term 0.
I20260808 14:37:18.533675 814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8a54aaf0ad47cd9a1fdf16a0b42d88" candidate_uuid: "765ed642b18347068e0805fcc55cbbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6c4c010fc04a59b8af7f516da83f98"
I20260808 14:37:18.533753 814 raft_consensus.cc:3037] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:18.534534 814 raft_consensus.cc:2454] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765ed642b18347068e0805fcc55cbbdb in term 1.
W20260808 14:37:18.539374 864 tablet.cc:2369] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:37:18.570493 879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.567120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51094 (local address 127.20.81.2:32785)
0808 14:37:18.567169 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:18.567171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:18.567179 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:37:18.567222 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:18.567223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:18.567245 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:18.567309 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:37:18.567513 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.568236 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.569362 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:18.569677 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:18.569739 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:18.569929 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:37:18.570077 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:37:18.570152 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:18.570373 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 14:37:18.570391 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:37:18.572969 814 raft_consensus.cc:1261] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [term 1 FOLLOWER]: Refusing update from remote peer 765ed642b18347068e0805fcc55cbbdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:18.572968 532 raft_consensus.cc:1261] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 2603f78d10e149d88b1c15685e4bb78c [term 1 FOLLOWER]: Refusing update from remote peer 765ed642b18347068e0805fcc55cbbdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:18.573331 892 consensus_queue.cc:1035] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d6c4c010fc04a59b8af7f516da83f98" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 41251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:18.573442 889 consensus_queue.cc:1035] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2603f78d10e149d88b1c15685e4bb78c" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:18.577850 895 mvcc.cc:205] Tried to move back new op lower bound from 7316274538791485440 to 7316274538607620096. Current Snapshot: MvccSnapshot[applied={T|T < 7316274538791485440}]
I20260808 14:37:18.578456 896 mvcc.cc:205] Tried to move back new op lower bound from 7316274538791485440 to 7316274538607620096. Current Snapshot: MvccSnapshot[applied={T|T < 7316274538791485440}]
I20260808 14:37:18.580868 361 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:18.580958 361 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:18.581782 361 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e5eaddc0986b42599724643897734e55: Sending DeleteTablet for 3 replicas of tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88
I20260808 14:37:18.582201 514 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:18 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:42482
I20260808 14:37:18.582427 656 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:18 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:51078
I20260808 14:37:18.582805 795 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:18 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:54346
I20260808 14:37:18.583447 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 448
I20260808 14:37:18.585803 898 mvcc.cc:205] Tried to move back new op lower bound from 7316274538791485440 to 7316274538607620096. Current Snapshot: MvccSnapshot[applied={T|T < 7316274538791485440}]
I20260808 14:37:18.589797 905 tablet_replica.cc:330] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: stopping tablet replica
I20260808 14:37:18.589730 906 tablet_replica.cc:330] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: stopping tablet replica
I20260808 14:37:18.590049 906 raft_consensus.cc:2229] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:18.590186 905 raft_consensus.cc:2229] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:37:18.590360 905 raft_consensus.cc:2258] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:18.590474 906 raft_consensus.cc:2258] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:18.591094 905 ts_tablet_manager.cc:1905] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:18.593353 905 ts_tablet_manager.cc:1918] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:18.594825 905 log.cc:1196] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/ef8a54aaf0ad47cd9a1fdf16a0b42d88
I20260808 14:37:18.595208 905 ts_tablet_manager.cc:1939] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 765ed642b18347068e0805fcc55cbbdb: Deleting consensus metadata
I20260808 14:37:18.595749 347 catalog_manager.cc:4841] TS 765ed642b18347068e0805fcc55cbbdb (127.20.81.2:32785): tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88 (table test-table [id=d02aad8b3bba4c919bb075a2de3b562f]) successfully deleted
I20260808 14:37:18.597836 906 ts_tablet_manager.cc:1905] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:18.599740 906 ts_tablet_manager.cc:1918] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:18.599877 906 log.cc:1196] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/ef8a54aaf0ad47cd9a1fdf16a0b42d88
I20260808 14:37:18.600260 906 ts_tablet_manager.cc:1939] T ef8a54aaf0ad47cd9a1fdf16a0b42d88 P 0d6c4c010fc04a59b8af7f516da83f98: Deleting consensus metadata
I20260808 14:37:18.600819 348 catalog_manager.cc:4841] TS 0d6c4c010fc04a59b8af7f516da83f98 (127.20.81.3:41251): tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88 (table test-table [id=d02aad8b3bba4c919bb075a2de3b562f]) successfully deleted
W20260808 14:37:18.613180 345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:43673 (error 108)
I20260808 14:37:18.620720 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 591
I20260808 14:37:18.626722 876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:18.626563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:43673 (local address 127.0.0.1:42484)
0808 14:37:18.626629 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:18.626674 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:43673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 14:37:18.627061 345 catalog_manager.cc:4584] TS 2603f78d10e149d88b1c15685e4bb78c (127.20.81.1:43673): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ef8a54aaf0ad47cd9a1fdf16a0b42d88: Network error: Client connection negotiation failed: client connection to 127.20.81.1:43673: connect: Connection refused (error 111)
I20260808 14:37:18.633958 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 730
I20260808 14:37:18.641717 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 327
I20260808 14:37:18.649437 20804 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:37:18.993907 20804 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:37:18.994006 20804 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:37:19.338577 20804 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:37:19.338 UTC [32359] LOG: received smart shutdown request
2026-08-08 14:37:19.342 UTC [32359] LOG: background worker "logical replication launcher" (PID 32369) exited with exit code 1
2026-08-08 14:37:19.342 UTC [32363] LOG: shutting down
2026-08-08 14:37:19.513 UTC [32359] LOG: database system is shut down
2026-08-08T14:37:19Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47604 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:37:19 dist-test-slave-8n49 krb5kdc[917](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:37:19 dist-test-slave-8n49 krb5kdc[917](info): set up 2 sockets
Aug 08 14:37:19 dist-test-slave-8n49 krb5kdc[917](info): commencing operation
krb5kdc: starting...
W20260808 14:37:20.716958 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:37:20 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:37:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:37:20Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.81.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.81.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/rangeradmin_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/rangeradmin_127.20.81.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.81.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.81.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/rangerlookup_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/rangerlookup_127.20.81.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.81.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.81.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/HTTP_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/HTTP_127.20.81.20@KRBTEST.COM.keytab.
I20260808 14:37:20.888774 20804 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskx904RQ/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/postgres -l logfile start
2026-08-08 14:37:23.335 UTC [950] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:37:23.335 UTC [950] LOG: listening on IPv4 address "127.20.81.20", port 40877
2026-08-08 14:37:23.339 UTC [950] LOG: listening on Unix socket "/tmp/.s.PGSQL.40877"
2026-08-08 14:37:23.367 UTC [953] LOG: database system was shut down at 2026-08-08 14:37:21 UTC
2026-08-08 14:37:23.373 UTC [950] LOG: database system is ready to accept connections
I20260808 14:37:24.357437 20804 mini_postgres.cc:96] Postgres bound to 40877
2026-08-08 14:37:24.364 UTC [962] FATAL: database "slave" does not exist
127.20.81.20:40877 - accepting connections
I20260808 14:37:24.365263 20804 mini_ranger.cc:161] Starting Ranger...
I20260808 14:37:24.381794 20804 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:37:24.878154 20804 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:37:24.878230 20804 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-admin
2026-08-08 14:37:25,160 [I] DB FLAVOR :POSTGRES
2026-08-08 14:37:25,160 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:37:25,160 [I] Checking connection..
2026-08-08 14:37:25,161 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:37:25,428 [I] Checking connection passed.
2026-08-08 14:37:25,428 [I] --------- Verifying version history table ---------
2026-08-08 14:37:25,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:37:25,659 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:37:25,659 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:37:25,899 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:37:25,900 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:37:25,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:37:26.129 UTC [1028] WARNING: there is no transaction in progress
2026-08-08 14:37:26,136 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:37:26,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:37:26,410 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:37:26,411 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:37:26,411 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:37:26,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:37:26,890 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8n49.c.gcp-upstream.internal','N') ;"
2026-08-08 14:37:27,143 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:37:27,404 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:37:27,404 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:37:27,673 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:37:27,673 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:37:27,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:37:28,183 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:37:28,183 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:37:29.152 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.169 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.185 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.201 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.216 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.232 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.290 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.297 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.312 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.322 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.333 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.347 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.357 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.364 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.371 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:29.378 UTC [1144] WARNING: there is no transaction in progress
2026-08-08 14:37:30,043 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:37:30,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:37:30,292 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:37:30,292 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:37:30,527 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:37:30,527 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:37:30,768 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:37:30,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:37:31,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:37:31,233 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8n49.c.gcp-upstream.internal';"
2026-08-08 14:37:31,492 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:37:31,493 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:37:31,749 [I] DB_PATCHES have already been applied
I20260808 14:37:31.755568 20804 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-admin:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskx904RQ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:37:31.755657 20804 mini_ranger.cc:193] Using host: 127.20.81.20
I20260808 14:37:31.759496 20804 mini_ranger.cc:227] Ranger admin URL: http://127.20.81.20:37109
Aug 08, 2026 2:37:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:37:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:37:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:37:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:37:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:37:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:37:32 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:37:32.913933 20804 mini_ranger.cc:160] Time spent starting Ranger: real 8.549s user 0.000s sys 0.010s
Aug 08, 2026 2:37:52 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:37:52 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 2:37:52 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:37:52 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:37:53 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:37:53.958761 20804 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.81.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.81.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/rangerkms_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.81.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/rangerkms_127.20.81.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.81.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.81.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.81.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/HTTP_127.20.81.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.81.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/HTTP_127.20.81.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:37:54 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199874, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:37:54.048599 20804 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:37:54.058929 20804 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:37:54.917284 20804 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:37:54.917379 20804 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-kms
I20260808 14:37:54.917402 20804 mini_ranger_kms.cc:227] Using postgres at 127.20.81.20:40877
2026-08-08 14:37:55,089 [I] DB FLAVOR :POSTGRES
2026-08-08 14:37:55,089 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:37:55,089 [I] Checking connection
2026-08-08 14:37:55,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:37:55,326 [I] connection success
2026-08-08 14:37:55,326 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:37:55,326 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:37:55,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:37:55,567 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:37:55,567 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:37:55,567 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:37:55,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.81.20:40877/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:37:55,816 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:37:56.256425 20804 mini_ranger_kms.cc:310] Created kms service
I20260808 14:37:56.465023 20804 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:37:56.516301 20804 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:37:56 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199874, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:37:56.931573 20804 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:37:56.931789 20804 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-kms:/tmp/dist-test-taskx904RQ/build/release/bin/postgresql.jar:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskx904RQ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:37:56.931809 20804 mini_ranger_kms.cc:240] Using host: 127.20.81.20
I20260808 14:37:56.936059 20804 mini_ranger_kms.cc:276] Ranger KMS PID: 1338
I20260808 14:37:56.936160 20804 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.81.20:35321
Aug 08, 2026 2:37:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:37:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:37:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:37:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:37:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:37:58 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:37:59 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199879, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.81.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:59.255208 20804 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.207s user 0.006s sys 0.149s
I20260808 14:37:59.255317 20804 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:37:59.255368 20804 mini_ranger_kms.cc:401] 127.20.81.20:35321/kms/v1/keys
Aug 08 14:37:59 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199879, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.81.20@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
Aug 08 14:37:59 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199879, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.81.20@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
Aug 08 14:38:02 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:38:02.163975 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:37865
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:37865
--ranger_config_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:35321/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:02.260042 1392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:02.260254 1392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:02.260277 1392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:02.261466 1392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:02.261509 1392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:02.261523 1392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:02.261535 1392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:02.261592 1392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:02.263144 1392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.81.20:35321/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:37865
--ranger_config_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:37865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:02.263388 1392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:02.263607 1392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:02.268836 1397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:02.268826 1400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:02.268826 1398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:02.268940 1392 server_base.cc:1034] running on GCE node
I20260808 14:38:02.269348 1392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:02.269642 1392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:02.270810 1392 hybrid_clock.cc:648] HybridClock initialized: now 1786199882270784 us; error 41 us; skew 500 ppm
Aug 08 14:38:02 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199882, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:02.273275 1392 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:38:02.273728 1392 webserver.cc:460] Webserver started at http://127.20.81.62:42583/ using document root <none> and password file <none>
I20260808 14:38:02.273953 1392 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:02.274013 1392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:02.274181 1392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:38:02 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199882, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:38:02.331102 1392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "facf36ebe4d14e389931b68a848dc543"
format_stamp: "Formatted at 2026-08-08 14:38:02 on dist-test-slave-8n49"
server_key: "336d94c5bb560eb814ca3358e7110c56"
server_key_iv: "f3762a0dabae0276b1556085d3c2a2da"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:02.331728 1392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "facf36ebe4d14e389931b68a848dc543"
format_stamp: "Formatted at 2026-08-08 14:38:02 on dist-test-slave-8n49"
server_key: "336d94c5bb560eb814ca3358e7110c56"
server_key_iv: "f3762a0dabae0276b1556085d3c2a2da"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:02.333696 1392 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:02.348661 1407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:02.348969 1392 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:02.349087 1392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "facf36ebe4d14e389931b68a848dc543"
format_stamp: "Formatted at 2026-08-08 14:38:02 on dist-test-slave-8n49"
server_key: "336d94c5bb560eb814ca3358e7110c56"
server_key_iv: "f3762a0dabae0276b1556085d3c2a2da"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:02.349195 1392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:02.360128 1392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:02.362458 1392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:02.362618 1392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:02.367693 1392 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:37865
I20260808 14:38:02.367730 1466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:37865 every 8 connection(s)
I20260808 14:38:02.368167 1392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:02.369071 1467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:02.371412 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 1392
I20260808 14:38:02.371527 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:38:02.371562 1467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Bootstrap starting.
I20260808 14:38:02.371742 20804 external_mini_cluster.cc:1428] Setting key 1947beef917c24923ee01972cd3b267c
I20260808 14:38:02.372428 1467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:02.372844 1467 log.cc:824] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:02.373646 1467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: No bootstrap required, opened a new log
I20260808 14:38:02.375667 1467 raft_consensus.cc:348] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } }
I20260808 14:38:02.375855 1467 raft_consensus.cc:374] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:02.375903 1467 raft_consensus.cc:729] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: facf36ebe4d14e389931b68a848dc543, State: Initialized, Role: FOLLOWER
I20260808 14:38:02.376070 1467 consensus_queue.cc:260] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } }
I20260808 14:38:02.376154 1467 raft_consensus.cc:388] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:02.376184 1467 raft_consensus.cc:482] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:02.376251 1467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:02.376950 1467 raft_consensus.cc:504] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } }
I20260808 14:38:02.377080 1467 leader_election.cc:302] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: facf36ebe4d14e389931b68a848dc543; no voters:
I20260808 14:38:02.377291 1467 leader_election.cc:288] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:02.377672 1467 sys_catalog.cc:564] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:02.377314 1473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:02.379253 1473 raft_consensus.cc:686] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 1 LEADER]: Becoming Leader. State: Replica: facf36ebe4d14e389931b68a848dc543, State: Running, Role: LEADER
I20260808 14:38:02.379441 1473 consensus_queue.cc:237] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } }
I20260808 14:38:02.379851 1473 sys_catalog.cc:455] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: SysCatalogTable state changed. Reason: New leader facf36ebe4d14e389931b68a848dc543. Latest consensus state: current_term: 1 leader_uuid: "facf36ebe4d14e389931b68a848dc543" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } } }
Aug 08 14:38:02 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:02.380023 1473 sys_catalog.cc:458] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:02.380501 1486 sys_catalog.cc:455] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "facf36ebe4d14e389931b68a848dc543" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } } }
I20260808 14:38:02.380671 1486 sys_catalog.cc:458] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:02.381179 1467 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:38:02.380692 1488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:02.384595 1488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:02.387710 1471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:02.372297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58022 (local address 127.20.81.62:37865)
0808 14:38:02.372501 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:02.372511 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:02.372544 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:38:02.373133 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:02.373143 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:02.373208 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:02.373366 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:02.374158 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:02.375571 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:02.376699 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:02.377318 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:02.377427 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:02.380511 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:02.380516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:02.380516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:02.380529 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:02.384868 (+ 4339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:02.385397 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:02.385401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:02.385401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:02.385628 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:02.385867 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:02.385868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:02.385868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:02.386541 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:02.386781 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:02.386871 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 14:38:02.387312 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":75,"threads_started":1}
I20260808 14:38:02.389472 1488 catalog_manager.cc:1347] Generated new cluster ID: 03a61769e19d4ba1924fe7736d9a8a68
I20260808 14:38:02.389524 1488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:02.404986 1488 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:02.405787 1488 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:02.411321 1488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Generated new TSK 0
I20260808 14:38:02.411580 1488 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:38:03.111840 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:35321/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:37865
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:03.201148 1518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:03.201378 1518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:03.201414 1518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:03.202666 1518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:03.202737 1518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:03.202783 1518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:38:03.204339 1518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.81.20:35321/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:37865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:03.204639 1518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:03.204879 1518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:03.210074 1525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:03.210074 1528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:03.210417 1524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:03.211097 1518 server_base.cc:1034] running on GCE node
I20260808 14:38:03.211319 1518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:03.211584 1518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:03.212742 1518 hybrid_clock.cc:648] HybridClock initialized: now 1786199883212720 us; error 36 us; skew 500 ppm
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:03.215708 1518 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:38:03.216220 1518 webserver.cc:460] Webserver started at http://127.20.81.1:41561/ using document root <none> and password file <none>
I20260808 14:38:03.216482 1518 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:03.216555 1518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:03.216725 1518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:38:03.232443 1518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "2427048045744cdc93d04605043ec6b2"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "06f4cdb263d8c44fd0c41c1a04766035"
server_key_iv: "aec7b6cbe4fb7b85575f7216633d7412"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:03.233242 1518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "2427048045744cdc93d04605043ec6b2"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "06f4cdb263d8c44fd0c41c1a04766035"
server_key_iv: "aec7b6cbe4fb7b85575f7216633d7412"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:03.235168 1518 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:03.249812 1535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.250007 1518 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:03.250103 1518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "2427048045744cdc93d04605043ec6b2"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "06f4cdb263d8c44fd0c41c1a04766035"
server_key_iv: "aec7b6cbe4fb7b85575f7216633d7412"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:03.250205 1518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:03.268545 1518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:03.271083 1518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:03.271298 1518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:03.271549 1518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:03.271970 1518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:03.272074 1518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.272179 1518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:03.272255 1518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.278978 1518 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:37837
I20260808 14:38:03.279501 1518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:38:03.280036 1659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:37837 every 8 connection(s)
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:03.288774 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 1518
I20260808 14:38:03.288887 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:38:03.289103 20804 external_mini_cluster.cc:1428] Setting key 2cdee79849f2ee65faee36302e5c4a1f
I20260808 14:38:03.291723 1663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:03.280780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:38087 (local address 127.20.81.62:37865)
0808 14:38:03.280946 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:03.280948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:03.281160 (+ 212us) server_negotiation.cc:407] Connection header received
0808 14:38:03.281868 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:03.281869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:03.281884 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:03.281930 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:03.282756 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.283582 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.285120 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.285439 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.285480 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:03.288158 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:03.288160 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:03.288160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:03.288168 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:03.290059 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.290612 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.290613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.290614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.290677 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.290950 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.290951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.290952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.291100 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:03.291144 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:03.291523 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 14:38:03.291611 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
I20260808 14:38:03.292657 1662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:03.280762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:37865 (local address 127.20.81.1:38087)
0808 14:38:03.281027 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:03.281074 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:03.281739 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:03.282127 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:03.282132 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:03.282378 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:03.282645 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:03.282651 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.283701 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.283702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:03.285019 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:03.285023 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.285585 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.285586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:03.285725 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:03.286331 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:03.286341 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:03.288046 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:03.290160 (+ 2114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:03.290168 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:03.290171 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:03.290516 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:03.290746 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:03.290747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:03.290747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:03.290874 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:03.291193 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:03.291199 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:03.291371 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 14:38:03.292171 (+ 800us) client_negotiation.cc:240] Negotiation successful
0808 14:38:03.292339 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":96,"threads_started":1}
I20260808 14:38:03.293382 1660 heartbeater.cc:347] Connected to a master server at 127.20.81.62:37865
I20260808 14:38:03.293475 1660 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:03.293658 1660 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
I20260808 14:38:03.294250 1427 ts_manager.cc:194] Registered new tserver with Master: 2427048045744cdc93d04605043ec6b2 (127.20.81.1:37837)
I20260808 14:38:03.295168 1427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:38087
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:38:03.325623 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:35321/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:37865
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:03.433332 1666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:03.433569 1666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:03.433609 1666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:03.434783 1666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:03.434852 1666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:03.434897 1666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:38:03.436398 1666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.81.20:35321/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:37865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:03.436702 1666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:03.436960 1666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:03.442410 1678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:03.442968 1676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:03.443181 1666 server_base.cc:1034] running on GCE node
W20260808 14:38:03.443239 1675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:03.443516 1666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:03.443783 1666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:03.447050 1666 hybrid_clock.cc:648] HybridClock initialized: now 1786199883447020 us; error 41 us; skew 500 ppm
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:03.450373 1666 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:38:03.450946 1666 webserver.cc:460] Webserver started at http://127.20.81.2:42705/ using document root <none> and password file <none>
I20260808 14:38:03.451269 1666 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:03.451337 1666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:03.451493 1666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:03.465603 1666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "998e79652a424193b3ea7a5c228960fc"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "877ddfb43879a2aca84c85a5e029f099"
server_key_iv: "05d604e9ff7ae38376960af628b623a3"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:03.466216 1666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "998e79652a424193b3ea7a5c228960fc"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "877ddfb43879a2aca84c85a5e029f099"
server_key_iv: "05d604e9ff7ae38376960af628b623a3"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:03.484472 1666 fs_manager.cc:691] Time spent creating directory manager: real 0.018s user 0.001s sys 0.000s
I20260808 14:38:03.505856 1686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.506067 1666 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:38:03.506175 1666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "998e79652a424193b3ea7a5c228960fc"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "877ddfb43879a2aca84c85a5e029f099"
server_key_iv: "05d604e9ff7ae38376960af628b623a3"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:03.506259 1666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:03.523008 1666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:03.525691 1666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:03.525923 1666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:03.526270 1666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:03.526715 1666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:03.526813 1666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.526898 1666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:03.526978 1666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.535295 1666 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:35709
I20260808 14:38:03.535372 1805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:35709 every 8 connection(s)
I20260808 14:38:03.535895 1666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:38:03.545374 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 1666
I20260808 14:38:03.545495 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:38:03.545734 20804 external_mini_cluster.cc:1428] Setting key ad57f59e125388868266af8fca03dab3
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:03.560822 1663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:03.536725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:58951 (local address 127.20.81.62:37865)
0808 14:38:03.536776 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:03.536778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:03.537273 (+ 495us) server_negotiation.cc:407] Connection header received
0808 14:38:03.537958 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:03.537959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:03.537973 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:03.538043 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:03.538790 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.539595 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.541121 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.541408 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.541484 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:03.554136 (+ 12652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:03.554138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:03.554138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:03.554148 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:03.558751 (+ 4603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.559401 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.559403 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.559404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.559473 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.559834 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.559835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.559835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.560006 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:03.560056 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:03.560524 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 14:38:03.560684 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:38:03.561657 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:03.536911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:37865 (local address 127.20.81.2:58951)
0808 14:38:03.537108 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:03.537159 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:03.537824 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:03.538122 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:03.538127 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:03.538380 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:03.538667 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:03.538673 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.539704 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.539706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:03.541025 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:03.541028 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.541583 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.541584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:03.541732 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:03.546091 (+ 4359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:03.546104 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:03.553992 (+ 7888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:03.558881 (+ 4889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:03.558896 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:03.558901 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:03.559292 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:03.559566 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:03.559567 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:03.559567 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:03.559748 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:03.560110 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:03.560118 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:03.560348 (+ 230us) client_negotiation.cc:769] Sending connection context
0808 14:38:03.561207 (+ 859us) client_negotiation.cc:240] Negotiation successful
0808 14:38:03.561395 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260808 14:38:03.562348 1806 heartbeater.cc:347] Connected to a master server at 127.20.81.62:37865
I20260808 14:38:03.562448 1806 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:03.562659 1806 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
I20260808 14:38:03.563072 1427 ts_manager.cc:194] Registered new tserver with Master: 998e79652a424193b3ea7a5c228960fc (127.20.81.2:35709)
I20260808 14:38:03.563601 1427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:58951
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:38:03.601775 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:35321/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:37865
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:03.729769 1812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:03.730124 1812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:03.730212 1812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:03.731958 1812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:03.732070 1812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:03.732156 1812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:38:03.734367 1812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.81.20:35321/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:37865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:03.734929 1812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:03.735248 1812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:03.743605 1817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:03.743955 1812 server_base.cc:1034] running on GCE node
W20260808 14:38:03.744395 1818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:03.744977 1820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:03.745282 1812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:03.745569 1812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:03.748821 1812 hybrid_clock.cc:648] HybridClock initialized: now 1786199883748795 us; error 35 us; skew 500 ppm
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:03.752418 1812 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:38:03.753093 1812 webserver.cc:460] Webserver started at http://127.20.81.3:35477/ using document root <none> and password file <none>
I20260808 14:38:03.753401 1812 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:03.753466 1812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:03.753646 1812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:38:03.774255 1812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "13e992f3922f45bc955e81e9a31c062a"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "ce3fd50e91aded388a105df8e916c56c"
server_key_iv: "dc15548065fe263f68930dbd40abe961"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:03.775883 1812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "13e992f3922f45bc955e81e9a31c062a"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "ce3fd50e91aded388a105df8e916c56c"
server_key_iv: "dc15548065fe263f68930dbd40abe961"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:03.778867 1812 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:38:03.794786 1829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.795035 1812 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:03.795131 1812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "13e992f3922f45bc955e81e9a31c062a"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "ce3fd50e91aded388a105df8e916c56c"
server_key_iv: "dc15548065fe263f68930dbd40abe961"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:03.795221 1812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:03.830803 1812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:03.837116 1812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:03.837368 1812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:03.837709 1812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:03.838197 1812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:03.838297 1812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.838382 1812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:03.838446 1812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.848718 1812 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:43647
I20260808 14:38:03.849335 1812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:38:03.851812 1950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:43647 every 8 connection(s)
I20260808 14:38:03.855541 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 1812
I20260808 14:38:03.855671 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:38:03.855859 20804 external_mini_cluster.cc:1428] Setting key e415ff24bb87c712a03a77d2c33cef46
Aug 08 14:38:03 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:03.864729 1663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:03.853358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:54279 (local address 127.20.81.62:37865)
0808 14:38:03.853415 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:03.853417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:03.853701 (+ 284us) server_negotiation.cc:407] Connection header received
0808 14:38:03.854550 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:03.854552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:03.854566 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:03.854600 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:03.855569 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.856366 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.858114 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.858412 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.858462 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:03.861241 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:03.861244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:03.861244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:03.861252 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:03.863058 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.863559 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.863561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.863561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.863622 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.863903 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.863904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.863904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.864055 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:03.864100 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:03.864501 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 14:38:03.864611 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:38:03.865599 1953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:03.853025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:37865 (local address 127.20.81.3:54279)
0808 14:38:03.853524 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:03.853609 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:03.854369 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:03.854831 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:03.854836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:03.855117 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:03.855408 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:03.855461 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.856679 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.856680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:03.858006 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:03.858009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.858573 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.858574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:03.858716 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:03.859349 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:03.859360 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:03.861120 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:03.863160 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:03.863167 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:03.863170 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:03.863467 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:03.863694 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:03.863695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:03.863695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:03.863826 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:03.864152 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:03.864158 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:03.864342 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 14:38:03.865187 (+ 845us) client_negotiation.cc:240] Negotiation successful
0808 14:38:03.865363 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":94,"threads_started":1}
I20260808 14:38:03.866256 1951 heartbeater.cc:347] Connected to a master server at 127.20.81.62:37865
I20260808 14:38:03.866353 1951 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:03.866544 1951 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
I20260808 14:38:03.866981 1427 ts_manager.cc:194] Registered new tserver with Master: 13e992f3922f45bc955e81e9a31c062a (127.20.81.3:43647)
I20260808 14:38:03.867468 1427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:54279
I20260808 14:38:03.867910 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:38:03.868625 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 1518
I20260808 14:38:03.888849 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 1666
I20260808 14:38:03.895942 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 1812
I20260808 14:38:03.905069 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 1392
I20260808 14:38:03.913656 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:37865
--webserver_interface=127.20.81.62
--webserver_port=42583
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:37865
--ranger_config_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:35321/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.81.20:35321/kms with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:04.012949 1954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:04.013161 1954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:04.013182 1954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:04.014346 1954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:04.014392 1954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:04.014406 1954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:04.014420 1954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:04.014432 1954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:04.016065 1954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.81.20:35321/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:37865
--ranger_config_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:37865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:04.016317 1954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:04.016592 1954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:04.022504 1960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:04.022552 1961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:04.022677 1954 server_base.cc:1034] running on GCE node
W20260808 14:38:04.022775 1963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:04.023037 1954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:04.023397 1954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:04.024600 1954 hybrid_clock.cc:648] HybridClock initialized: now 1786199884024568 us; error 42 us; skew 500 ppm
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:04.027758 1954 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:38:04.028317 1954 webserver.cc:460] Webserver started at http://127.20.81.62:42583/ using document root <none> and password file <none>
I20260808 14:38:04.028621 1954 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:04.028695 1954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:38:04.081073 1954 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:04.082047 1971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.082206 1954 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:04.082278 1954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "facf36ebe4d14e389931b68a848dc543"
format_stamp: "Formatted at 2026-08-08 14:38:02 on dist-test-slave-8n49"
server_key: "336d94c5bb560eb814ca3358e7110c56"
server_key_iv: "f3762a0dabae0276b1556085d3c2a2da"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:04.082765 1954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:04.092124 1954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:04.093910 1954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:04.094022 1954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:04.098315 1954 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:37865
I20260808 14:38:04.098356 2031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:37865 every 8 connection(s)
I20260808 14:38:04.098730 1954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:04.099948 2032 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:38:04.100713 2032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Bootstrap starting.
I20260808 14:38:04.101717 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 1954
I20260808 14:38:04.102037 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:35321/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:37837
--local_ip_for_outbound_sockets=127.20.81.1
--tserver_master_addrs=127.20.81.62:37865
--webserver_port=41561
--webserver_interface=127.20.81.1
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.81.20:35321/kms with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:04.109537 2032 log.cc:824] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:04.111219 2032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:38:04.111515 2032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Bootstrap complete.
I20260808 14:38:04.113979 2032 raft_consensus.cc:348] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } }
I20260808 14:38:04.114223 2032 raft_consensus.cc:729] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: facf36ebe4d14e389931b68a848dc543, State: Initialized, Role: FOLLOWER
I20260808 14:38:04.114388 2032 consensus_queue.cc:260] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } }
I20260808 14:38:04.114459 2032 raft_consensus.cc:388] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:04.114521 2032 raft_consensus.cc:482] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:04.114568 2032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:38:04.115547 2032 raft_consensus.cc:504] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } }
I20260808 14:38:04.115659 2032 leader_election.cc:302] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: facf36ebe4d14e389931b68a848dc543; no voters:
I20260808 14:38:04.115857 2032 leader_election.cc:288] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:38:04.115895 2036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:38:04.116007 2036 raft_consensus.cc:686] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [term 2 LEADER]: Becoming Leader. State: Replica: facf36ebe4d14e389931b68a848dc543, State: Running, Role: LEADER
I20260808 14:38:04.116173 2032 sys_catalog.cc:564] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:04.116160 2036 consensus_queue.cc:237] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } }
I20260808 14:38:04.116638 2037 sys_catalog.cc:455] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "facf36ebe4d14e389931b68a848dc543" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } } }
I20260808 14:38:04.116657 2038 sys_catalog.cc:455] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: SysCatalogTable state changed. Reason: New leader facf36ebe4d14e389931b68a848dc543. Latest consensus state: current_term: 2 leader_uuid: "facf36ebe4d14e389931b68a848dc543" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "facf36ebe4d14e389931b68a848dc543" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 37865 } } }
I20260808 14:38:04.116837 2037 sys_catalog.cc:458] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:04.116847 2038 sys_catalog.cc:458] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:04.117076 2045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:04.117653 2045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:04.117817 2045 catalog_manager.cc:1259] Loaded cluster ID: 03a61769e19d4ba1924fe7736d9a8a68
I20260808 14:38:04.117897 2045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:04.118098 2032 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:38:04.119148 2045 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:04.119328 2045 catalog_manager.cc:5879] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Loaded TSK: 0
I20260808 14:38:04.119550 2045 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:38:04.217238 2034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:04.217516 2034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:04.217553 2034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:04.219307 2034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:04.219367 2034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:04.219406 2034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:38:04.221668 2034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.81.20:35321/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:37837
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=41561
--tserver_master_addrs=127.20.81.62:37865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:04.222083 2034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:04.222353 2034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:04.231859 2071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:04.232003 2074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:04.231865 2072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:04.233142 2034 server_base.cc:1034] running on GCE node
I20260808 14:38:04.233376 2034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:04.233678 2034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:04.234877 2034 hybrid_clock.cc:648] HybridClock initialized: now 1786199884234847 us; error 47 us; skew 500 ppm
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:04.238648 2034 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:38:04.239270 2034 webserver.cc:460] Webserver started at http://127.20.81.1:41561/ using document root <none> and password file <none>
I20260808 14:38:04.239575 2034 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:04.239677 2034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:38:04.261790 2034 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.001s
I20260808 14:38:04.264730 2083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.264921 2034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260808 14:38:04.265009 2034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "2427048045744cdc93d04605043ec6b2"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "06f4cdb263d8c44fd0c41c1a04766035"
server_key_iv: "aec7b6cbe4fb7b85575f7216633d7412"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:04.265491 2034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:04.281560 2034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:04.283880 2034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:04.284051 2034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:04.284329 2034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:04.284760 2034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:04.284818 2034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.284888 2034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:04.284934 2034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.291639 2034 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:37837
I20260808 14:38:04.291728 2219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:37837 every 8 connection(s)
I20260808 14:38:04.292083 2034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:38:04.298952 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 2034
I20260808 14:38:04.299274 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:35321/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:35709
--local_ip_for_outbound_sockets=127.20.81.2
--tserver_master_addrs=127.20.81.62:37865
--webserver_port=42705
--webserver_interface=127.20.81.2
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.81.20:35321/kms with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:04.304824 2222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:04.292823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:37865 (local address 127.20.81.1:48931)
0808 14:38:04.293019 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:04.293069 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:04.293697 (+ 628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:04.294164 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:04.294169 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:04.294418 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:04.294690 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:04.294697 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.295796 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.295797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:04.297143 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:04.297146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.297912 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.297913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:04.298060 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:04.298567 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:04.298579 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:04.300244 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:04.302764 (+ 2520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:04.302771 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:04.302773 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:04.303078 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:04.303408 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:04.303409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:04.303409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:04.303542 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:04.304065 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:04.304072 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:04.304242 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 14:38:04.304363 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 14:38:04.304546 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":103,"threads_started":1}
I20260808 14:38:04.305527 2224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:04.292989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:48931 (local address 127.20.81.62:37865)
0808 14:38:04.293181 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:04.293191 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:04.293229 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:38:04.293910 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:04.293916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:04.293961 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:04.294071 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:04.294805 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.295682 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.297249 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.297795 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.297881 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:04.300397 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:04.300453 (+ 56us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:04.300454 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:04.300466 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:04.302661 (+ 2195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:04.303188 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:04.303192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:04.303192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:04.303310 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:04.303621 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:04.303622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:04.303622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:04.303940 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:04.304031 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:04.305130 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0808 14:38:04.305275 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":84,"threads_started":1}
I20260808 14:38:04.306264 2220 heartbeater.cc:347] Connected to a master server at 127.20.81.62:37865
I20260808 14:38:04.306371 2220 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:04.306559 2220 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
W20260808 14:38:04.307471 2220 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:37865 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:38:04.307559 2220 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:04.307626 2220 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
I20260808 14:38:04.308023 2220 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:04.308104 2220 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
W20260808 14:38:04.308434 2220 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:38:04.411235 2225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:04.411639 2225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:04.411732 2225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:04.413636 2225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:04.413704 2225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:04.413746 2225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:38:04.415810 2225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.81.20:35321/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:35709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=42705
--tserver_master_addrs=127.20.81.62:37865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:04.416076 2225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:04.416395 2225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:04.422693 2233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:04.422703 2231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:04.423058 2230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:04.423583 2225 server_base.cc:1034] running on GCE node
I20260808 14:38:04.423786 2225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:04.424080 2225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:04.425273 2225 hybrid_clock.cc:648] HybridClock initialized: now 1786199884425247 us; error 41 us; skew 500 ppm
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:04.429504 2225 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:38:04.430030 2225 webserver.cc:460] Webserver started at http://127.20.81.2:42705/ using document root <none> and password file <none>
I20260808 14:38:04.430279 2225 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:04.430367 2225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:38:04.451507 2225 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.001s
I20260808 14:38:04.452334 2242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.452585 2225 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:04.452697 2225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "998e79652a424193b3ea7a5c228960fc"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "877ddfb43879a2aca84c85a5e029f099"
server_key_iv: "05d604e9ff7ae38376960af628b623a3"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:04.453178 2225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:04.470825 2225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:04.473141 2225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:04.473304 2225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:04.473549 2225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:04.473941 2225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:04.473995 2225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.474064 2225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:04.474093 2225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.481248 2225 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:35709
I20260808 14:38:04.481328 2364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:35709 every 8 connection(s)
I20260808 14:38:04.481699 2225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:38:04.486233 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 2225
I20260808 14:38:04.486584 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.81.20:35321/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:43647
--local_ip_for_outbound_sockets=127.20.81.3
--tserver_master_addrs=127.20.81.62:37865
--webserver_port=35477
--webserver_interface=127.20.81.3
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.81.20:35321/kms with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:04.492635 2224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:04.482513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:48201 (local address 127.20.81.62:37865)
0808 14:38:04.482573 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:04.482575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:04.482795 (+ 220us) server_negotiation.cc:407] Connection header received
0808 14:38:04.483546 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:04.483548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:04.483562 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:04.483624 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:04.484366 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.485004 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.486363 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.486618 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.486656 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:04.489204 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:04.489206 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:04.489206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:04.489214 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:04.490950 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:04.491462 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:04.491464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:04.491464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:04.491524 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:04.491840 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:04.491841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:04.491842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:04.491978 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:04.492024 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:04.492421 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 14:38:04.492512 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:38:04.492825 2367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:04.482456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:37865 (local address 127.20.81.2:48201)
0808 14:38:04.482650 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:04.482702 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:04.483390 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:04.483706 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:04.483711 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:04.483963 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:04.484256 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:04.484264 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.485104 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.485105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:04.486250 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:04.486254 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.486784 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.486785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:04.486943 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:04.487528 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:04.487539 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:04.489083 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:04.491054 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:04.491060 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:04.491063 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:04.491364 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:04.491602 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:04.491603 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:04.491603 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:04.491749 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:04.492076 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:04.492082 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:04.492256 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 14:38:04.492375 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 14:38:04.492543 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260808 14:38:04.493376 2365 heartbeater.cc:347] Connected to a master server at 127.20.81.62:37865
I20260808 14:38:04.493498 2365 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:04.493688 2365 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
W20260808 14:38:04.494364 2365 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:37865 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:38:04.494448 2365 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:04.494524 2365 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
I20260808 14:38:04.494817 2365 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:04.494896 2365 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
W20260808 14:38:04.495174 2365 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:38:04.612385 2368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:04.612838 2368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:04.612953 2368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:04.614741 2368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:04.614853 2368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:04.614945 2368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:38:04.617467 2368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.81.20:35321/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:43647
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=35477
--tserver_master_addrs=127.20.81.62:37865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:04.617792 2368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:04.618114 2368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:04.624922 2374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:04.625200 2373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:04.624965 2377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:04.625064 2368 server_base.cc:1034] running on GCE node
I20260808 14:38:04.625537 2368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:04.625845 2368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:04.627049 2368 hybrid_clock.cc:648] HybridClock initialized: now 1786199884627013 us; error 51 us; skew 500 ppm
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:04.631531 2368 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:38:04.632046 2368 webserver.cc:460] Webserver started at http://127.20.81.3:35477/ using document root <none> and password file <none>
I20260808 14:38:04.632330 2368 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:04.632422 2368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:38:04.649861 2368 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:04.651733 2387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.652175 2368 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:04.652292 2368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "13e992f3922f45bc955e81e9a31c062a"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-8n49"
server_key: "ce3fd50e91aded388a105df8e916c56c"
server_key_iv: "dc15548065fe263f68930dbd40abe961"
server_key_version: "kuduclusterkey@0"
I20260808 14:38:04.652814 2368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:04.674088 2368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:04.676123 2368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:04.676306 2368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:04.676611 2368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:04.677035 2368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:04.677101 2368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.677141 2368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:04.677166 2368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:04.684024 2368 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:43647
I20260808 14:38:04.684340 2513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:43647 every 8 connection(s)
I20260808 14:38:04.684541 2368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:38:04.687484 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 2368
Aug 08 14:38:04 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:04.697109 2224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:04.685764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:43739 (local address 127.20.81.62:37865)
0808 14:38:04.685822 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:04.685824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:04.686068 (+ 244us) server_negotiation.cc:407] Connection header received
0808 14:38:04.686614 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:04.686616 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:04.686630 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:04.686690 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:04.687377 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.688130 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.689788 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.690064 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.690105 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:04.693694 (+ 3589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:04.693695 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:04.693695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:04.693703 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:04.695432 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:04.695919 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:04.695921 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:04.695921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:04.695979 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:04.696290 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:04.696292 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:04.696292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:04.696450 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:04.696499 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:04.696941 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 14:38:04.697017 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:38:04.697608 2516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:04.685781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:37865 (local address 127.20.81.3:43739)
0808 14:38:04.685943 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:04.685985 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:04.686501 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:04.686765 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:04.686769 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:04.687032 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:04.687231 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:04.687236 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.688299 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.688299 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:04.689676 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:04.689679 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.690207 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.690208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:04.690341 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:04.691833 (+ 1492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:04.691844 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:04.693591 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:04.695508 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:04.695515 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:04.695517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:04.695821 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:04.696056 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:04.696056 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:04.696057 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:04.696207 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:04.696573 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:04.696580 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:04.696769 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 14:38:04.697222 (+ 453us) client_negotiation.cc:240] Negotiation successful
0808 14:38:04.697405 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260808 14:38:04.698174 2514 heartbeater.cc:347] Connected to a master server at 127.20.81.62:37865
I20260808 14:38:04.698303 2514 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:04.698493 2514 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
W20260808 14:38:04.699180 2514 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:37865 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:38:04.699267 2514 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:04.699344 2514 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
I20260808 14:38:04.699637 2514 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:04.699713 2514 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
W20260808 14:38:04.699998 2514 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:38:04.701867 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:04.688243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58028 (local address 127.20.81.62:37865)
0808 14:38:04.689035 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:04.689037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:04.689044 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:38:04.689065 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:04.689065 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:04.689076 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:04.689132 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:04.689911 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.690666 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.692647 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:04.692960 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:04.693030 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:04.695136 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:04.695138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:04.695138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:04.695146 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:04.696920 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:04.700962 (+ 4042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:04.700963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:04.700963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:04.701025 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:04.701241 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:04.701242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:04.701242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:04.701358 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:04.701558 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:04.701596 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 14:38:04.701679 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":766,"thread_start_us":70,"threads_started":1}
Aug 08 14:38:05 dist-test-slave-8n49 krb5kdc[917](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199885, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:05.308658 2220 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:05.308835 2220 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
I20260808 14:38:05.309347 1990 ts_manager.cc:194] Registered new tserver with Master: 2427048045744cdc93d04605043ec6b2 (127.20.81.1:37837)
I20260808 14:38:05.310381 1990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:48931
I20260808 14:38:05.495396 2365 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:05.495604 2365 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
I20260808 14:38:05.496017 1990 ts_manager.cc:194] Registered new tserver with Master: 998e79652a424193b3ea7a5c228960fc (127.20.81.2:35709)
I20260808 14:38:05.496459 1990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:48201
Aug 08 14:38:05 dist-test-slave-8n49 krb5kdc[917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199885, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for HTTP/127.20.81.20@KRBTEST.COM
I20260808 14:38:05.700214 2514 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:05.700382 2514 heartbeater.cc:511] Master 127.20.81.62:37865 requested a full tablet report, sending...
I20260808 14:38:05.700798 1990 ts_manager.cc:194] Registered new tserver with Master: 13e992f3922f45bc955e81e9a31c062a (127.20.81.3:43647)
I20260808 14:38:05.701344 1990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:43739
I20260808 14:38:05.705809 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:38:05.718469 2537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.706898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58032 (local address 127.20.81.62:37865)
0808 14:38:05.707412 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:05.707414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:05.707421 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:38:05.707446 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:05.707446 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:05.707458 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:05.708240 (+ 782us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:05.708281 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.709072 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.710162 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.710469 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.710533 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.715056 (+ 4523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:05.715058 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:05.715059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:05.715068 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:05.717014 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:05.717511 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:05.717512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:05.717513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:05.717580 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:05.717827 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:05.717828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:05.717828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:05.717985 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:05.718090 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:05.718267 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 14:38:05.718360 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":74,"threads_started":1}
I20260808 14:38:05.721210 1990 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58032:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:38:05.723536 1990 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:38:05.732090 2547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.726930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:35709 (local address 127.0.0.1:35948)
0808 14:38:05.727467 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:05.727509 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:05.727576 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:05.727918 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:05.727922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:05.727926 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:05.728006 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.728008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.729383 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.729385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.730694 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.730698 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.731766 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.731767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.731852 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.731866 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:38:05.731948 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:38:05.732001 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":99,"threads_started":1}
I20260808 14:38:05.732717 2548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.727210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35948 (local address 127.20.81.2:35709)
0808 14:38:05.727716 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:05.727722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:05.727732 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:38:05.727771 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:05.727774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:05.727791 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:05.727938 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:05.728110 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.729282 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.730801 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.731577 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.731655 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.731728 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:05.732590 (+ 862us) server_negotiation.cc:299] Negotiation successful
0808 14:38:05.732636 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":71,"threads_started":1}
I20260808 14:38:05.733587 2296 tablet_service.cc:1467] Processing CreateTablet for tablet 0951d436d4cd4cbc853efda24240d397 (DEFAULT_TABLE table=test-table [id=83611b8739fb4001b848cbfbb1d1ef21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:05.734001 2296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0951d436d4cd4cbc853efda24240d397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:05.735231 2549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.727412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34284 (local address 127.20.81.3:43647)
0808 14:38:05.728059 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:05.728063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:05.728877 (+ 814us) server_negotiation.cc:407] Connection header received
0808 14:38:05.729001 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:05.729003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:05.729019 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:05.729072 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:05.729774 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.731160 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.734026 (+ 2866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.734739 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.734802 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.734873 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:05.735096 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 14:38:05.735152 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":58,"threads_started":1}
I20260808 14:38:05.735800 2544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.727200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:43647 (local address 127.0.0.1:34284)
0808 14:38:05.728818 (+ 1618us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:05.728826 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:05.728909 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:05.729620 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:05.729621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:05.729623 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:05.729682 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.729684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.731267 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.731268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.732354 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.732357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.734938 (+ 2581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.734939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.734999 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.735004 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:38:05.735675 (+ 671us) client_negotiation.cc:240] Negotiation successful
0808 14:38:05.735728 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1602,"mutex_wait_us":15,"thread_start_us":77,"threads_started":1}
I20260808 14:38:05.736382 2545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.726977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:37837 (local address 127.0.0.1:51004)
0808 14:38:05.728673 (+ 1696us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:05.728685 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:05.728737 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:05.729461 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:05.729462 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:05.729464 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:05.729523 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.729525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.733983 (+ 4458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.733984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.735101 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.735103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.736145 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.736146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.736221 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.736225 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:38:05.736272 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:38:05.736311 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1678,"thread_start_us":93,"threads_started":1}
I20260808 14:38:05.736630 2546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.727083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51004 (local address 127.20.81.1:37837)
0808 14:38:05.729222 (+ 2139us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:05.729226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:05.729236 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:38:05.729273 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:05.729276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:05.729290 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:05.729372 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:05.732877 (+ 3505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.733887 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.735208 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.735958 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.736039 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.736106 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:05.736482 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 14:38:05.736525 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2100,"thread_start_us":50,"threads_started":1}
I20260808 14:38:05.736503 2439 tablet_service.cc:1467] Processing CreateTablet for tablet 0951d436d4cd4cbc853efda24240d397 (DEFAULT_TABLE table=test-table [id=83611b8739fb4001b848cbfbb1d1ef21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:05.736971 2439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0951d436d4cd4cbc853efda24240d397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:05.737257 2124 tablet_service.cc:1467] Processing CreateTablet for tablet 0951d436d4cd4cbc853efda24240d397 (DEFAULT_TABLE table=test-table [id=83611b8739fb4001b848cbfbb1d1ef21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:05.737576 2124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0951d436d4cd4cbc853efda24240d397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:05.741007 2551 tablet_bootstrap.cc:492] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: Bootstrap starting.
I20260808 14:38:05.741779 2551 tablet_bootstrap.cc:654] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:05.742131 2551 log.cc:824] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:05.742493 2553 tablet_bootstrap.cc:492] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2: Bootstrap starting.
I20260808 14:38:05.742996 2551 tablet_bootstrap.cc:492] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: No bootstrap required, opened a new log
I20260808 14:38:05.743078 2551 ts_tablet_manager.cc:1397] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:05.744753 2550 tablet_bootstrap.cc:492] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc: Bootstrap starting.
I20260808 14:38:05.745616 2550 tablet_bootstrap.cc:654] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:05.745828 2551 raft_consensus.cc:348] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } }
I20260808 14:38:05.746001 2551 raft_consensus.cc:374] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:05.746011 2550 log.cc:824] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:05.746063 2551 raft_consensus.cc:729] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e992f3922f45bc955e81e9a31c062a, State: Initialized, Role: FOLLOWER
I20260808 14:38:05.746250 2551 consensus_queue.cc:260] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } }
I20260808 14:38:05.746673 2514 heartbeater.cc:503] Master 127.20.81.62:37865 was elected leader, sending a full tablet report...
I20260808 14:38:05.746907 2550 tablet_bootstrap.cc:492] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc: No bootstrap required, opened a new log
I20260808 14:38:05.746969 2550 ts_tablet_manager.cc:1397] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:05.747269 2553 tablet_bootstrap.cc:654] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:05.747587 2553 log.cc:824] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:05.747743 2551 ts_tablet_manager.cc:1428] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:38:05.748811 2553 tablet_bootstrap.cc:492] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2: No bootstrap required, opened a new log
I20260808 14:38:05.748901 2553 ts_tablet_manager.cc:1397] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 14:38:05.749177 2550 raft_consensus.cc:348] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } }
I20260808 14:38:05.749342 2550 raft_consensus.cc:374] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:05.749373 2550 raft_consensus.cc:729] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998e79652a424193b3ea7a5c228960fc, State: Initialized, Role: FOLLOWER
I20260808 14:38:05.749536 2550 consensus_queue.cc:260] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } }
I20260808 14:38:05.749779 2550 ts_tablet_manager.cc:1428] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:05.749825 2365 heartbeater.cc:503] Master 127.20.81.62:37865 was elected leader, sending a full tablet report...
I20260808 14:38:05.751298 2553 raft_consensus.cc:348] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } }
I20260808 14:38:05.751453 2553 raft_consensus.cc:374] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:05.751499 2553 raft_consensus.cc:729] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2427048045744cdc93d04605043ec6b2, State: Initialized, Role: FOLLOWER
I20260808 14:38:05.751628 2553 consensus_queue.cc:260] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } }
I20260808 14:38:05.751914 2553 ts_tablet_manager.cc:1428] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:05.751976 2220 heartbeater.cc:503] Master 127.20.81.62:37865 was elected leader, sending a full tablet report...
W20260808 14:38:05.797837 2221 tablet.cc:2369] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:38:05.820871 2556 raft_consensus.cc:482] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:38:05.821048 2556 raft_consensus.cc:504] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } }
I20260808 14:38:05.821465 2556 leader_election.cc:288] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998e79652a424193b3ea7a5c228960fc (127.20.81.2:35709), 2427048045744cdc93d04605043ec6b2 (127.20.81.1:37837)
I20260808 14:38:05.825881 2548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.821929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:40833 (local address 127.20.81.2:35709)
0808 14:38:05.821977 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:05.821979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:05.822174 (+ 195us) server_negotiation.cc:407] Connection header received
0808 14:38:05.822290 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:05.822291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:05.822304 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:05.822337 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:05.822575 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.823282 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.824868 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.825451 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.825508 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.825520 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:05.825749 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 14:38:05.825803 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:38:05.826046 2546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.821929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:34571 (local address 127.20.81.1:37837)
0808 14:38:05.821978 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:05.821980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:05.822120 (+ 140us) server_negotiation.cc:407] Connection header received
0808 14:38:05.822234 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:05.822235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:05.822248 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:05.822280 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:05.822521 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.823277 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.824879 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.825610 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.825665 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.825675 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:05.825929 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 14:38:05.825974 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:38:05.826262 2561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.821703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:37837 (local address 127.20.81.3:34571)
0808 14:38:05.822048 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:05.822059 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:05.822153 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:05.822351 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:05.822352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:05.822354 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:05.822446 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.822448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.823403 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.823404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.824766 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.824770 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.825760 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.825761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.825838 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.825842 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:38:05.826131 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 14:38:05.826178 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":2,"thread_start_us":95,"threads_started":1}
I20260808 14:38:05.826586 2560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.821704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:35709 (local address 127.20.81.3:40833)
0808 14:38:05.822098 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:05.822109 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:05.822207 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:05.822420 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:05.822421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:05.822423 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:05.822493 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.822495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.823392 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.823405 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.824749 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:05.824752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.825588 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.825589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:05.825659 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.825663 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:38:05.826444 (+ 781us) client_negotiation.cc:240] Negotiation successful
0808 14:38:05.826482 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":91,"thread_start_us":108,"threads_started":1}
I20260808 14:38:05.826792 2171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0951d436d4cd4cbc853efda24240d397" candidate_uuid: "13e992f3922f45bc955e81e9a31c062a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2427048045744cdc93d04605043ec6b2" is_pre_election: true
I20260808 14:38:05.826973 2171 raft_consensus.cc:2454] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e992f3922f45bc955e81e9a31c062a in term 0.
I20260808 14:38:05.826970 2316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0951d436d4cd4cbc853efda24240d397" candidate_uuid: "13e992f3922f45bc955e81e9a31c062a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998e79652a424193b3ea7a5c228960fc" is_pre_election: true
I20260808 14:38:05.827116 2316 raft_consensus.cc:2454] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e992f3922f45bc955e81e9a31c062a in term 0.
I20260808 14:38:05.827234 2388 leader_election.cc:302] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e992f3922f45bc955e81e9a31c062a, 2427048045744cdc93d04605043ec6b2; no voters:
I20260808 14:38:05.827409 2556 raft_consensus.cc:2781] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:38:05.827486 2556 raft_consensus.cc:482] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:38:05.827510 2556 raft_consensus.cc:3037] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:05.828518 2556 raft_consensus.cc:504] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } }
I20260808 14:38:05.828701 2556 leader_election.cc:288] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [CANDIDATE]: Term 1 election: Requested vote from peers 998e79652a424193b3ea7a5c228960fc (127.20.81.2:35709), 2427048045744cdc93d04605043ec6b2 (127.20.81.1:37837)
I20260808 14:38:05.828908 2316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0951d436d4cd4cbc853efda24240d397" candidate_uuid: "13e992f3922f45bc955e81e9a31c062a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998e79652a424193b3ea7a5c228960fc"
I20260808 14:38:05.828908 2171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0951d436d4cd4cbc853efda24240d397" candidate_uuid: "13e992f3922f45bc955e81e9a31c062a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2427048045744cdc93d04605043ec6b2"
I20260808 14:38:05.828990 2171 raft_consensus.cc:3037] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:05.828990 2316 raft_consensus.cc:3037] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:05.829871 2316 raft_consensus.cc:2454] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e992f3922f45bc955e81e9a31c062a in term 1.
I20260808 14:38:05.829941 2171 raft_consensus.cc:2454] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e992f3922f45bc955e81e9a31c062a in term 1.
I20260808 14:38:05.830050 2389 leader_election.cc:302] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e992f3922f45bc955e81e9a31c062a, 998e79652a424193b3ea7a5c228960fc; no voters:
I20260808 14:38:05.830159 2556 raft_consensus.cc:2781] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:05.830310 2556 raft_consensus.cc:686] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 1 LEADER]: Becoming Leader. State: Replica: 13e992f3922f45bc955e81e9a31c062a, State: Running, Role: LEADER
I20260808 14:38:05.830394 2556 consensus_queue.cc:237] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } }
I20260808 14:38:05.831219 1990 catalog_manager.cc:5495] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a reported cstate change: term changed from 0 to 1, leader changed from <none> to 13e992f3922f45bc955e81e9a31c062a (127.20.81.3). New cstate: current_term: 1 leader_uuid: "13e992f3922f45bc955e81e9a31c062a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13e992f3922f45bc955e81e9a31c062a" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 43647 } health_report { overall_health: HEALTHY } } }
I20260808 14:38:05.850287 2549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.847149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34294 (local address 127.20.81.3:43647)
0808 14:38:05.847216 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:05.847218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:05.847227 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:38:05.847270 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:05.847271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:05.847296 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:05.847374 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:05.847529 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.848234 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.849342 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.849632 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.849701 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.849888 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:05.850028 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:05.850109 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:05.850183 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 14:38:05.850208 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:38:05.852576 2171 raft_consensus.cc:1261] T 0951d436d4cd4cbc853efda24240d397 P 2427048045744cdc93d04605043ec6b2 [term 1 FOLLOWER]: Refusing update from remote peer 13e992f3922f45bc955e81e9a31c062a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:05.852612 2316 raft_consensus.cc:1261] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [term 1 FOLLOWER]: Refusing update from remote peer 13e992f3922f45bc955e81e9a31c062a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:05.852945 2556 consensus_queue.cc:1035] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [LEADER]: Connected to new peer: Peer: permanent_uuid: "998e79652a424193b3ea7a5c228960fc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 35709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:05.853078 2562 consensus_queue.cc:1035] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2427048045744cdc93d04605043ec6b2" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:05.858455 1989 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:05.858551 1989 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:05.859298 2565 mvcc.cc:205] Tried to move back new op lower bound from 7316274732449062912 to 7316274732361932800. Current Snapshot: MvccSnapshot[applied={T|T < 7316274732449062912 or (T in {7316274732449062912})}]
I20260808 14:38:05.860472 1989 catalog_manager.cc:5782] T 00000000000000000000000000000000 P facf36ebe4d14e389931b68a848dc543: Sending DeleteTablet for 3 replicas of tablet 0951d436d4cd4cbc853efda24240d397
I20260808 14:38:05.860539 2567 mvcc.cc:205] Tried to move back new op lower bound from 7316274732449062912 to 7316274732361932800. Current Snapshot: MvccSnapshot[applied={T|T < 7316274732449062912}]
I20260808 14:38:05.860832 2296 tablet_service.cc:1514] Processing DeleteTablet for tablet 0951d436d4cd4cbc853efda24240d397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:05 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:35948
I20260808 14:38:05.861574 2124 tablet_service.cc:1514] Processing DeleteTablet for tablet 0951d436d4cd4cbc853efda24240d397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:05 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:51004
I20260808 14:38:05.861586 2439 tablet_service.cc:1514] Processing DeleteTablet for tablet 0951d436d4cd4cbc853efda24240d397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:05 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:34284
I20260808 14:38:05.862370 2566 mvcc.cc:205] Tried to move back new op lower bound from 7316274732449062912 to 7316274732361932800. Current Snapshot: MvccSnapshot[applied={T|T < 7316274732449062912}]
I20260808 14:38:05.862460 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 2034
I20260808 14:38:05.871256 2577 tablet_replica.cc:330] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: stopping tablet replica
I20260808 14:38:05.871457 2577 raft_consensus.cc:2229] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:38:05.871666 2577 raft_consensus.cc:2258] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:05.871891 2573 tablet_replica.cc:330] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc: stopping tablet replica
I20260808 14:38:05.872037 2573 raft_consensus.cc:2229] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:05.872196 2573 raft_consensus.cc:2258] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:05.872783 2573 ts_tablet_manager.cc:1905] T 0951d436d4cd4cbc853efda24240d397 P 998e79652a424193b3ea7a5c228960fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:05.874882 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 2225
W20260808 14:38:05.875413 1972 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:37837 (error 108)
I20260808 14:38:05.893239 2577 ts_tablet_manager.cc:1905] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:05.901265 2577 ts_tablet_manager.cc:1918] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:05.901377 2577 log.cc:1196] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/0951d436d4cd4cbc853efda24240d397
I20260808 14:38:05.901710 2577 ts_tablet_manager.cc:1939] T 0951d436d4cd4cbc853efda24240d397 P 13e992f3922f45bc955e81e9a31c062a: Deleting consensus metadata
I20260808 14:38:05.902253 1974 catalog_manager.cc:4841] TS 13e992f3922f45bc955e81e9a31c062a (127.20.81.3:43647): tablet 0951d436d4cd4cbc853efda24240d397 (table test-table [id=83611b8739fb4001b848cbfbb1d1ef21]) successfully deleted
I20260808 14:38:05.903512 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 2368
I20260808 14:38:05.906683 2544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.906529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:37837 (local address 127.0.0.1:51018)
0808 14:38:05.906581 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:05.906634 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:37837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 14:38:05.906816 2544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.906681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:35709 (local address 127.0.0.1:35950)
0808 14:38:05.906775 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:05.906801 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.2:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260808 14:38:05.907004 1973 catalog_manager.cc:4584] TS 998e79652a424193b3ea7a5c228960fc (127.20.81.2:35709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0951d436d4cd4cbc853efda24240d397: Network error: Client connection negotiation failed: client connection to 127.20.81.2:35709: connect: Connection refused (error 111)
I20260808 14:38:05.924777 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 1954
I20260808 14:38:05.932348 20804 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:38:06.277000 20804 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:38:06.277143 20804 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:38:06.621795 20804 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:38:06.622 UTC [950] LOG: received smart shutdown request
2026-08-08 14:38:06.626 UTC [950] LOG: background worker "logical replication launcher" (PID 960) exited with exit code 1
2026-08-08 14:38:06.627 UTC [954] LOG: shutting down
2026-08-08 14:38:06.795 UTC [950] LOG: database system is shut down
2026-08-08T14:38:06Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47269 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:06 dist-test-slave-8n49 krb5kdc[2587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:06 dist-test-slave-8n49 krb5kdc[2587](info): set up 2 sockets
Aug 08 14:38:06 dist-test-slave-8n49 krb5kdc[2587](info): commencing operation
krb5kdc: starting...
W20260808 14:38:07.988951 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:38:08.113492 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44827
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:44827,127.20.81.61:44099,127.20.81.60:46541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:08.195317 2603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:08.195530 2603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:08.195554 2603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:08.196635 2603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:08.196669 2603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:08.196683 2603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:08.196696 2603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:08.196708 2603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:08.198156 2603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:44827,127.20.81.61:44099,127.20.81.60:46541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:44827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:08.198356 2603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:08.198532 2603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:08.203421 2609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:08.203425 2611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:08.203495 2608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:08.203675 2603 server_base.cc:1034] running on GCE node
I20260808 14:38:08.203908 2603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:08.204211 2603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:08.205377 2603 hybrid_clock.cc:648] HybridClock initialized: now 1786199888205363 us; error 26 us; skew 500 ppm
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:08.207801 2603 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:38:08.208267 2603 webserver.cc:460] Webserver started at http://127.20.81.62:46869/ using document root <none> and password file <none>
I20260808 14:38:08.208510 2603 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:08.208601 2603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:08.208757 2603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:08.209864 2603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "98cb819df6944428a1907dd3b45801f8"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-8n49"
server_key: "bbfc0d3cea6fd171cc0d298a28812934"
server_key_iv: "a828010aa253ed6da881f483f73c6af2"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.210256 2603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "98cb819df6944428a1907dd3b45801f8"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-8n49"
server_key: "bbfc0d3cea6fd171cc0d298a28812934"
server_key_iv: "a828010aa253ed6da881f483f73c6af2"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.211767 2603 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:38:08.212618 2618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:08.212805 2603 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:08.212918 2603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "98cb819df6944428a1907dd3b45801f8"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-8n49"
server_key: "bbfc0d3cea6fd171cc0d298a28812934"
server_key_iv: "a828010aa253ed6da881f483f73c6af2"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.213007 2603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:08.222651 2603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:08.224681 2603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:08.224840 2603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:08.228951 2603 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:44827
I20260808 14:38:08.228986 2673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:44827 every 8 connection(s)
I20260808 14:38:08.229353 2603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:08.230296 2674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:08.231860 2674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:08.238559 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 2603
I20260808 14:38:08.238708 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:38:08.238924 20804 external_mini_cluster.cc:1428] Setting key 91d62716c045fb5be62703a002ab031e
I20260808 14:38:08.241309 2680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.232624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52648 (local address 127.20.81.62:44827)
0808 14:38:08.232806 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.232811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.232875 (+ 64us) server_negotiation.cc:407] Connection header received
0808 14:38:08.233428 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.233430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.233453 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.233539 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.234080 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.234877 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.235698 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.236012 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.236088 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.238085 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.238092 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.238092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.238098 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.239673 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.240074 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.240077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.240077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.240163 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.240444 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.240445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.240446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.240738 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.240807 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.241047 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.241146 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":111,"threads_started":1}
I20260808 14:38:08.241397 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.232535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44827 (local address 127.0.0.1:52648)
0808 14:38:08.232756 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.232799 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:08.233270 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:08.233584 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:08.233587 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:08.233838 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:08.233996 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.233999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.234959 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.234960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.235627 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.235629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.236087 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.236087 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.236143 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.236658 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:08.236666 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:08.238008 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:08.239785 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.239792 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.239794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.239984 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.240240 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.240241 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.240242 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.240350 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.240811 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:08.240818 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:08.240900 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 14:38:08.241009 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 14:38:08.241231 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":54,"thread_start_us":98,"threads_started":1}
I20260808 14:38:08.242374 2674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:08.242776 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.242627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44099 (local address 127.0.0.1:47468)
0808 14:38:08.242686 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.242743 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 14:38:08.242944 2620 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
I20260808 14:38:08.243428 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.243320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44099 (local address 127.0.0.1:47484)
0808 14:38:08.243370 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.243404 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 14:38:08.243551 2674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.61:44099: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.20.81.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab.
Entry for principal kudu/127.20.81.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab.
I20260808 14:38:08.263734 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.61:44099
--webserver_interface=127.20.81.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab
--principal=kudu/127.20.81.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:44827,127.20.81.61:44099,127.20.81.60:46541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:08.292788 2674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } attempt: 1
I20260808 14:38:08.293371 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.293210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44099 (local address 127.0.0.1:47488)
0808 14:38:08.293283 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.293333 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 14:38:08.293830 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.293729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44099 (local address 127.0.0.1:47496)
0808 14:38:08.293777 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.293807 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:38:08.293975 2674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.61:44099: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
W20260808 14:38:08.347287 2688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:08.347501 2688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:08.347524 2688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:08.348762 2688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:08.348804 2688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:08.348819 2688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:08.348832 2688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:08.348845 2688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:08.350415 2688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:44827,127.20.81.61:44099,127.20.81.60:46541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab
--principal=kudu/127.20.81.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.61:44099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.81.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:08.350692 2688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:08.350927 2688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:08.355906 2693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:08.355911 2694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:08.355921 2697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:08.356105 2688 server_base.cc:1034] running on GCE node
I20260808 14:38:08.356371 2688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:08.356691 2688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:08.357838 2688 hybrid_clock.cc:648] HybridClock initialized: now 1786199888357826 us; error 28 us; skew 500 ppm
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:08.360330 2688 init.cc:377] Logged in from keytab as kudu/127.20.81.61@KRBTEST.COM (short username kudu)
I20260808 14:38:08.360817 2688 webserver.cc:460] Webserver started at http://127.20.81.61:41723/ using document root <none> and password file <none>
I20260808 14:38:08.361011 2688 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:08.361055 2688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:08.361145 2688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:08.362172 2674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } attempt: 2
I20260808 14:38:08.362249 2688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/data/instance:
uuid: "5b85fd7677614cee859fe84ae56bba31"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-8n49"
server_key: "2c0f101ae34c7f072833f003fbd0ac23"
server_key_iv: "9889c2280a309946e883f69e544b6214"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.362601 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.362467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44099 (local address 127.0.0.1:47500)
0808 14:38:08.362532 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.362571 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 14:38:08.362763 2688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/wal/instance:
uuid: "5b85fd7677614cee859fe84ae56bba31"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-8n49"
server_key: "2c0f101ae34c7f072833f003fbd0ac23"
server_key_iv: "9889c2280a309946e883f69e544b6214"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.362911 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.362822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44099 (local address 127.0.0.1:47508)
0808 14:38:08.362865 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.362889 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:38:08.363005 2674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.61:44099: Network error: Client connection negotiation failed: client connection to 127.20.81.61:44099: connect: Connection refused (error 111)
I20260808 14:38:08.364264 2688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:38:08.365118 2706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:08.365301 2688 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:08.365404 2688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/wal
uuid: "5b85fd7677614cee859fe84ae56bba31"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-8n49"
server_key: "2c0f101ae34c7f072833f003fbd0ac23"
server_key_iv: "9889c2280a309946e883f69e544b6214"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.365491 2688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:08.382782 2688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:08.384927 2688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:08.385106 2688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:08.389593 2688 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.61:44099
I20260808 14:38:08.389650 2763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.61:44099 every 8 connection(s)
I20260808 14:38:08.390018 2688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
I20260808 14:38:08.390892 2764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:08.392683 2764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:08.398887 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 2688
I20260808 14:38:08.399035 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-1/wal/instance
I20260808 14:38:08.399314 20804 external_mini_cluster.cc:1428] Setting key 06253a30c966552d0219da29d1fa8609
I20260808 14:38:08.402029 2680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.393474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52654 (local address 127.20.81.62:44827)
0808 14:38:08.393540 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.393542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.393753 (+ 211us) server_negotiation.cc:407] Connection header received
0808 14:38:08.394255 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.394257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.394273 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.394337 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.394952 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.395453 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.396437 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.396707 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.396786 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.398796 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.398797 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.398798 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.398806 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.400664 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.401069 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.401071 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.401071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.401137 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.401390 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.401391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.401391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.401510 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.401590 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.401851 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.401937 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:38:08.402218 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.393441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44827 (local address 127.0.0.1:52654)
0808 14:38:08.393630 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.393668 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:08.394147 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:08.394412 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:08.394415 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:08.394665 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:08.394851 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.394855 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.395562 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.395564 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.396342 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.396344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.396795 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.396796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.396924 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.397360 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:08.397368 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:08.398698 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:08.400745 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.400751 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.400753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.400963 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.401209 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.401210 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.401210 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.401312 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.401582 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:08.401589 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:08.401718 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 14:38:08.401829 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:38:08.401983 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":97,"threads_started":1}
I20260808 14:38:08.402755 2764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.81.60@KRBTEST.COM; defaulting to no policy
I20260808 14:38:08.410106 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.403016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44099 (local address 127.0.0.1:47516)
0808 14:38:08.403226 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.403238 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:08.403287 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:08.403434 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:08.403434 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:08.403571 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:08.403618 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.403620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.404457 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.404458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.405008 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.405010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.405472 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.405473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.405537 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.405969 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:08.405973 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:08.407366 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:08.409187 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.409188 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.409188 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.409348 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.409539 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.409540 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.409540 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.409593 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.409853 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:08.409854 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:08.409892 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:38:08.409970 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:38:08.410045 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
I20260808 14:38:08.410257 2769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.403086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47516 (local address 127.20.81.61:44099)
0808 14:38:08.403234 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.403240 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.403286 (+ 46us) server_negotiation.cc:407] Connection header received
0808 14:38:08.403344 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.403346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.403359 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.403428 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.403691 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.404369 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.405105 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.405396 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.405475 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.407465 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.407473 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.407473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.407479 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.409099 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.409427 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.409429 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.409430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.409479 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.409649 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.409650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.409650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.409773 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.409863 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.410004 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.410095 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":118,"thread_start_us":94,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.60@KRBTEST.COM" created.
I20260808 14:38:08.410935 2764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:08.411298 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.411162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48192)
0808 14:38:08.411212 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.411264 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 14:38:08.411453 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
I20260808 14:38:08.411923 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.411818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48194)
0808 14:38:08.411864 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.411892 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:38:08.412075 2764 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:46541: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab.
Entry for principal kudu/127.20.81.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab.
I20260808 14:38:08.425732 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.60:46541
--webserver_interface=127.20.81.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab
--principal=kudu/127.20.81.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:44827,127.20.81.61:44099,127.20.81.60:46541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:08.454167 2674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } attempt: 3
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:38:08.461311 2764 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } attempt: 1
I20260808 14:38:08.461690 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.461573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48204)
0808 14:38:08.461621 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.461649 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 14:38:08.461846 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.454584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44099 (local address 127.0.0.1:47518)
0808 14:38:08.454658 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.454678 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:08.454753 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:08.454925 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:08.454927 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:08.455095 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:08.455161 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.455163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.455866 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.455868 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.456399 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.456401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.456866 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.456867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.456961 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.457437 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:08.457443 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:08.458892 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:08.460672 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.460674 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.460674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.460850 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.461062 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.461062 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.461063 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.461129 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.461457 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:08.461458 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:08.461514 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 14:38:08.461615 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:38:08.461717 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:38:08.461992 2769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.454668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47518 (local address 127.20.81.61:44099)
0808 14:38:08.454742 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.454744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.454756 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:38:08.454825 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.454826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.454844 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.454910 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.455259 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.455780 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.456505 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.456786 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.456868 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.458995 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.458996 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.458997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.459004 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.460509 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.460931 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.460932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.460933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.460992 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.461197 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.461198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.461198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.461358 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.461431 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.461812 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.461898 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:38:08.462215 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.462020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48208)
0808 14:38:08.462163 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.462188 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
W20260808 14:38:08.462343 2764 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:46541: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
I20260808 14:38:08.462356 2674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:08.462702 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.462561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48210)
0808 14:38:08.462622 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.462665 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 14:38:08.463109 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.462976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48220)
0808 14:38:08.463050 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.463079 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 14:38:08.463248 2674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:46541: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
I20260808 14:38:08.494449 2674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } attempt: 1
I20260808 14:38:08.494978 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.494837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48228)
0808 14:38:08.494909 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.494951 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:38:08.495366 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.495286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48232)
0808 14:38:08.495327 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.495350 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:38:08.495555 2674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:46541: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
W20260808 14:38:08.509357 2772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:08.509562 2772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:08.509584 2772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:08.510706 2772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:08.510747 2772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:08.510762 2772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:08.510775 2772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:08.510787 2772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:08.512279 2772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:44827,127.20.81.61:44099,127.20.81.60:46541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab
--principal=kudu/127.20.81.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.60:46541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.81.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:08.512558 2772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:08.512837 2772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:08.517724 2778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:08.517715 2779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:08.517897 2772 server_base.cc:1034] running on GCE node
W20260808 14:38:08.517724 2782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:08.518234 2772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:08.518520 2772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:08.519685 2772 hybrid_clock.cc:648] HybridClock initialized: now 1786199888519665 us; error 40 us; skew 500 ppm
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:08.522161 2772 init.cc:377] Logged in from keytab as kudu/127.20.81.60@KRBTEST.COM (short username kudu)
I20260808 14:38:08.522615 2772 webserver.cc:460] Webserver started at http://127.20.81.60:41777/ using document root <none> and password file <none>
I20260808 14:38:08.522854 2772 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:08.522899 2772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:08.523072 2772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:08.524145 2772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/data/instance:
uuid: "c0e6829620734b0ca90b7100acfabe7b"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-8n49"
server_key: "5dc1655258ed8f8d302549b58f8c0195"
server_key_iv: "e1b59c3a5f4268fa2d38e07d0d8d533a"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.524616 2772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/wal/instance:
uuid: "c0e6829620734b0ca90b7100acfabe7b"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-8n49"
server_key: "5dc1655258ed8f8d302549b58f8c0195"
server_key_iv: "e1b59c3a5f4268fa2d38e07d0d8d533a"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.526114 2772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:08.526861 2789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:08.527067 2772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:08.527160 2772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/wal
uuid: "c0e6829620734b0ca90b7100acfabe7b"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-8n49"
server_key: "5dc1655258ed8f8d302549b58f8c0195"
server_key_iv: "e1b59c3a5f4268fa2d38e07d0d8d533a"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.527232 2772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:08.530499 2764 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } attempt: 2
I20260808 14:38:08.530918 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.530779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48234)
0808 14:38:08.530844 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.530884 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 14:38:08.531279 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.531195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48248)
0808 14:38:08.531238 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.531263 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:38:08.531417 2764 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:46541: Network error: Client connection negotiation failed: client connection to 127.20.81.60:46541: connect: Connection refused (error 111)
I20260808 14:38:08.538506 2772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:08.540514 2772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:08.540723 2772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:08.544849 2772 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.60:46541
I20260808 14:38:08.544988 2846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.60:46541 every 8 connection(s)
I20260808 14:38:08.545281 2772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
I20260808 14:38:08.546175 2847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:08.547730 2847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:08.550709 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 2772
I20260808 14:38:08.550828 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199735403457-20804-0/minicluster-data/master-2/wal/instance
I20260808 14:38:08.551047 20804 external_mini_cluster.cc:1428] Setting key 77eb4f7872c7a5a71a0f639fa5a62bbf
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:38:08.557693 2680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.548445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52668 (local address 127.20.81.62:44827)
0808 14:38:08.548519 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.548521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.548757 (+ 236us) server_negotiation.cc:407] Connection header received
0808 14:38:08.549188 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.549189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.549199 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.549254 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.549831 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.550304 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.551718 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.551991 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.552052 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.554447 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.554449 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.554449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.554456 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.556100 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.556625 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.556626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.556626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.556677 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.556966 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.556967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.556968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.557126 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.557199 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.557490 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.557559 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:38:08.557833 2850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.548425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:44827 (local address 127.0.0.1:52668)
0808 14:38:08.548641 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.548677 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:08.549107 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:08.549315 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:08.549318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:08.549568 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:08.549761 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.549765 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.550381 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.550382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.551612 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.551615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.552102 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.552103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.552278 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.552910 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:08.552918 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:08.554352 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:08.556186 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.556194 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.556197 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.556497 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.556745 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.556746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.556747 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.556891 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.557195 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:08.557201 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:08.557339 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 14:38:08.557444 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 14:38:08.557624 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":81,"threads_started":1}
I20260808 14:38:08.558605 2847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:08.560302 2853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.551439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48264 (local address 127.20.81.60:46541)
0808 14:38:08.551602 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.551606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.551623 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:38:08.551717 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.551722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.551745 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.551822 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.552589 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.553346 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.554126 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.554551 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.554603 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.557343 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.557350 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.557350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.557356 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.559119 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.559472 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.559475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.559475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.559534 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.559735 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.559737 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.559737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.559880 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.560072 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.560117 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.560191 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:08.565445 2850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.558858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:44099 (local address 127.0.0.1:47522)
0808 14:38:08.558908 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.558919 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:08.558955 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:08.559143 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:08.559144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:08.559278 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:08.559306 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.559307 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.559931 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.559932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.560540 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.560542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.560996 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.560997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.561076 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.561479 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:08.561485 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:08.562672 (+ 1187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:08.564413 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.564414 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.564415 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.564639 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.564839 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.564840 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.564840 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.564901 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.565125 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:08.565126 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:08.565170 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:38:08.565262 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:38:08.565354 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:38:08.565446 2769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.558945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47522 (local address 127.20.81.61:44099)
0808 14:38:08.559022 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.559024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.559032 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:38:08.559056 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.559057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.559067 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.559140 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.559382 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.559843 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.560640 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.560918 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.560987 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.562762 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.562764 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.562764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.562771 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.564325 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.564717 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.564717 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.564718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.564768 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.564962 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.564962 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.564962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.565053 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.565132 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.565288 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.565360 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:38:08.566210 2847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:08.568141 2680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.561120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52682 (local address 127.20.81.62:44827)
0808 14:38:08.561154 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.561155 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.561178 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:38:08.561260 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.561261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.561271 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.561326 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.561933 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.562353 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.563043 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.563219 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.563298 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.565481 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.565483 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.565483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.565490 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.566946 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.567343 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.567345 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.567345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.567398 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.567625 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.567626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.567626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.567738 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.567922 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.567958 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.568033 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:38:08.570696 2674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } attempt: 2
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:38:08.574581 2850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.566537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48280)
0808 14:38:08.566569 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.566578 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:08.566613 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:08.567176 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:08.567177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:08.567283 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:08.567311 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.567312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.567905 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.567906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.568644 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.568646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.569155 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.569156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.569210 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.569637 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:08.569642 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:08.571114 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:08.573451 (+ 2337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.573452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.573453 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.573683 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.573897 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.573898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.573899 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.573959 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.574204 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:08.574205 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:08.574256 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 14:38:08.574330 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:38:08.574427 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:38:08.574632 2853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.566587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48280 (local address 127.20.81.60:46541)
0808 14:38:08.567067 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.567068 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.567076 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:38:08.567096 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.567096 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.567108 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.567164 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.567392 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.567828 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.568741 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.568984 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.569075 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.571200 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.571201 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.571201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.571207 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.573361 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.573766 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.573767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.573767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.573824 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.574021 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.574022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.574022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.574143 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.574208 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.574372 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.574484 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":459}
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:38:08.576792 2847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b: Bootstrap starting.
I20260808 14:38:08.577637 2847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:08.577970 2847 log.cc:824] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:08.578555 2769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.569083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47526 (local address 127.20.81.61:44099)
0808 14:38:08.569126 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.569129 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.569181 (+ 52us) server_negotiation.cc:407] Connection header received
0808 14:38:08.569281 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.569282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.569293 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.569352 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.570341 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.571244 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.572239 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.572571 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.572628 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.575224 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.575225 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.575226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.575234 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.576990 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.577415 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.577416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.577417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.577472 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.577700 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.577702 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.577702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.577845 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.578340 (+ 495us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.578385 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.578462 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:38:08.578881 2847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b: No bootstrap required, opened a new log
I20260808 14:38:08.580034 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.571252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48292)
0808 14:38:08.571326 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.571336 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:08.571371 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:08.572513 (+ 1142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:08.572514 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:08.572705 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:08.572746 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.572749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.573948 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.573949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.574739 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.574742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.575189 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.575190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.575248 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.575646 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:08.575652 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:08.577044 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:08.578926 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.578927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.578927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.579146 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.579348 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.579349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.579349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.579406 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.579719 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:08.579720 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:08.579766 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:38:08.579835 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:38:08.579929 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 14:38:08.580056 2854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.571025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48292 (local address 127.20.81.60:46541)
0808 14:38:08.572372 (+ 1347us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.572374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.572380 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:38:08.572413 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.572413 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.572423 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.572493 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.572848 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.573851 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.574830 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.575109 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.575187 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.577132 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.577133 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.577134 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.577141 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.578834 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.579215 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.579216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.579216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.579298 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.579490 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.579491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.579492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.579646 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.579723 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.579859 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.579930 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1325,"thread_start_us":751,"threads_started":1}
I20260808 14:38:08.580307 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:08.581065 2847 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } }
I20260808 14:38:08.581218 2847 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:08.581254 2847 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6829620734b0ca90b7100acfabe7b, State: Initialized, Role: FOLLOWER
I20260808 14:38:08.581377 2847 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } }
I20260808 14:38:08.581635 2674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8: Bootstrap starting.
I20260808 14:38:08.581682 2847 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:08.582429 2674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:08.582767 2674 log.cc:824] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:08.583624 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.583913 2674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8: No bootstrap required, opened a new log
I20260808 14:38:08.584048 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:38:08.585142 2878 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:08.585243 2878 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:08.586202 2674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } }
I20260808 14:38:08.586350 2674 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:08.586395 2674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98cb819df6944428a1907dd3b45801f8, State: Initialized, Role: FOLLOWER
I20260808 14:38:08.586509 2674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } }
I20260808 14:38:08.586818 2674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:08.590272 2854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.582219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48300 (local address 127.20.81.60:46541)
0808 14:38:08.582257 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.582259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.582265 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:38:08.582284 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.582285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.582295 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.582348 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.582981 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.583700 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.584758 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.585059 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.585101 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.586523 (+ 1422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.586525 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.586525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.586533 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.588845 (+ 2312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.589239 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.589240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.589240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.589300 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.589509 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.589510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.589510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.589633 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.589720 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.590104 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.590184 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:38:08.589385 2603 master_runner.cc:186] Error getting master registration for 127.20.81.61:44099: OK, instance_id { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" instance_seqno: 1786199888388262 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:38:08.592023 2603 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:38:08.594460 2769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.581707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47540 (local address 127.20.81.61:44099)
0808 14:38:08.582012 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.582014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.582022 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:38:08.582042 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.582043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.582053 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.582102 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.582888 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.583616 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.584788 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.585079 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.585114 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.587410 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.587411 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.587411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.587419 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.592935 (+ 5516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.593392 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.593394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.593394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.593456 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.593660 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.593661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.593661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.593778 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.593878 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.594285 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.594365 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280}
I20260808 14:38:08.592828 2772 master_runner.cc:186] Error getting master registration for 127.20.81.61:44099: OK, instance_id { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" instance_seqno: 1786199888388262 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:38:08.595646 2772 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:38:08.592737 2881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.595732 2881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:38:08.596602 2894 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:08.596700 2894 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:08.600245 2680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.585341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52686 (local address 127.20.81.62:44827)
0808 14:38:08.585382 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.585383 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.587702 (+ 2319us) server_negotiation.cc:407] Connection header received
0808 14:38:08.587804 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.587805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.587815 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.587845 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.593650 (+ 5805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.594332 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.595449 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.595722 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.595785 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.597294 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.597295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.597296 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.597303 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.598942 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.599348 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.599349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.599349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.599407 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.599615 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.599616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.599616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.599743 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.599829 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.600076 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.600152 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:38:08.622622 2764 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } attempt: 3
Aug 08 14:38:08 dist-test-slave-8n49 krb5kdc[2587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:38:08.631239 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.622915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:46541 (local address 127.0.0.1:48316)
0808 14:38:08.622971 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:08.622982 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:08.623024 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:08.623198 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:08.623199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:08.623392 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:08.623450 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.623452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.624403 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.624404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.625239 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:08.625242 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.625721 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.625723 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:08.625781 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.626306 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:08.626311 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:08.627862 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:08.629797 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.629798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.629799 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.630071 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.630290 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:08.630291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:08.630291 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:08.630345 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:08.630668 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:08.630669 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:08.630945 (+ 276us) client_negotiation.cc:769] Sending connection context
0808 14:38:08.631029 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 14:38:08.631134 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 14:38:08.631624 2854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.622988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48316 (local address 127.20.81.60:46541)
0808 14:38:08.623032 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.623034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.623043 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:38:08.623097 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.623097 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.623107 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.623171 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.623532 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.624314 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.625331 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.625636 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.625712 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.627955 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.627956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.627957 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.627964 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.629711 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.630159 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.630161 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.630161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.630220 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.630408 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.630409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.630409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.630580 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.630641 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.631452 (+ 811us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.631532 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:38:08.633302 2764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31: Bootstrap starting.
I20260808 14:38:08.634111 2764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:08.634440 2764 log.cc:824] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:08.635360 2764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31: No bootstrap required, opened a new log
I20260808 14:38:08.637522 2764 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } }
I20260808 14:38:08.637670 2764 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:08.637705 2764 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b85fd7677614cee859fe84ae56bba31, State: Initialized, Role: FOLLOWER
I20260808 14:38:08.637884 2764 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } }
I20260808 14:38:08.638223 2764 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:08.638195 2899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.638401 2899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:38:08.640763 2911 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:08.640877 2911 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:08.642838 2688 master_runner.cc:263] No leader master found from master 5b85fd7677614cee859fe84ae56bba31
I20260808 14:38:08.642889 2688 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:38:08.677023 2899 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:38:08.677167 2899 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } }
I20260808 14:38:08.677459 2899 leader_election.cc:288] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98cb819df6944428a1907dd3b45801f8 (127.20.81.62:44827), c0e6829620734b0ca90b7100acfabe7b (127.20.81.60:46541)
I20260808 14:38:08.678179 2820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b85fd7677614cee859fe84ae56bba31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6829620734b0ca90b7100acfabe7b" is_pre_election: true
I20260808 14:38:08.678334 2820 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b85fd7677614cee859fe84ae56bba31 in term 0.
I20260808 14:38:08.678785 2646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b85fd7677614cee859fe84ae56bba31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98cb819df6944428a1907dd3b45801f8" is_pre_election: true
I20260808 14:38:08.678931 2646 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b85fd7677614cee859fe84ae56bba31 in term 0.
I20260808 14:38:08.679309 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b85fd7677614cee859fe84ae56bba31, c0e6829620734b0ca90b7100acfabe7b; no voters:
I20260808 14:38:08.679637 2899 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:38:08.679697 2899 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:38:08.679723 2899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:08.680967 2899 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } }
I20260808 14:38:08.681102 2899 leader_election.cc:288] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [CANDIDATE]: Term 1 election: Requested vote from peers 98cb819df6944428a1907dd3b45801f8 (127.20.81.62:44827), c0e6829620734b0ca90b7100acfabe7b (127.20.81.60:46541)
I20260808 14:38:08.681391 2646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b85fd7677614cee859fe84ae56bba31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98cb819df6944428a1907dd3b45801f8"
I20260808 14:38:08.681471 2646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:08.682401 2646 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b85fd7677614cee859fe84ae56bba31 in term 1.
I20260808 14:38:08.682628 2820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b85fd7677614cee859fe84ae56bba31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6829620734b0ca90b7100acfabe7b"
I20260808 14:38:08.682735 2820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:08.683635 2820 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b85fd7677614cee859fe84ae56bba31 in term 1.
I20260808 14:38:08.683899 2710 leader_election.cc:302] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b85fd7677614cee859fe84ae56bba31, 98cb819df6944428a1907dd3b45801f8; no voters:
I20260808 14:38:08.684165 2899 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:08.684341 2899 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [term 1 LEADER]: Becoming Leader. State: Replica: 5b85fd7677614cee859fe84ae56bba31, State: Running, Role: LEADER
I20260808 14:38:08.684432 2899 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } }
I20260808 14:38:08.684834 2899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b85fd7677614cee859fe84ae56bba31. Latest consensus state: current_term: 1 leader_uuid: "5b85fd7677614cee859fe84ae56bba31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.684906 2899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:08.685237 2915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:08.685472 2915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:08.687772 2820 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [term 1 FOLLOWER]: Refusing update from remote peer 5b85fd7677614cee859fe84ae56bba31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:08.688071 2646 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [term 1 FOLLOWER]: Refusing update from remote peer 5b85fd7677614cee859fe84ae56bba31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:08.688649 2899 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:08.688796 2899 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:08.690183 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b85fd7677614cee859fe84ae56bba31. Latest consensus state: current_term: 1 leader_uuid: "5b85fd7677614cee859fe84ae56bba31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.690287 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:08.691399 2881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b85fd7677614cee859fe84ae56bba31. Latest consensus state: current_term: 1 leader_uuid: "5b85fd7677614cee859fe84ae56bba31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.691504 2881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:08.694082 2899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b85fd7677614cee859fe84ae56bba31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.694167 2899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:08.694639 2881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b85fd7677614cee859fe84ae56bba31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.694715 2881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:08.694975 2916 mvcc.cc:205] Tried to move back new op lower bound from 7316274744062246912 to 7316274744052080640. Current Snapshot: MvccSnapshot[applied={T|T < 7316274744062246912}]
I20260808 14:38:08.695210 2919 mvcc.cc:205] Tried to move back new op lower bound from 7316274744062246912 to 7316274744052080640. Current Snapshot: MvccSnapshot[applied={T|T < 7316274744062246912}]
I20260808 14:38:08.696092 2899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b85fd7677614cee859fe84ae56bba31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.696174 2899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:08.696619 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b85fd7677614cee859fe84ae56bba31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98cb819df6944428a1907dd3b45801f8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 44827 } } peers { permanent_uuid: "5b85fd7677614cee859fe84ae56bba31" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 44099 } } peers { permanent_uuid: "c0e6829620734b0ca90b7100acfabe7b" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 46541 } } }
I20260808 14:38:08.696724 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:08.697402 2917 mvcc.cc:205] Tried to move back new op lower bound from 7316274744062246912 to 7316274744052080640. Current Snapshot: MvccSnapshot[applied={T|T < 7316274744062246912}]
I20260808 14:38:08.698727 2915 catalog_manager.cc:1347] Generated new cluster ID: 8611638ae4f64e7881f14c26a5f34c06
I20260808 14:38:08.698776 2915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:08.732159 2915 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:08.733043 2915 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:08.740489 2915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b85fd7677614cee859fe84ae56bba31: Generated new TSK 0
I20260808 14:38:08.740789 2915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:09.585839 2878 catalog_manager.cc:1259] Loaded cluster ID: 8611638ae4f64e7881f14c26a5f34c06
I20260808 14:38:09.585939 2878 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b: loading cluster ID for follower catalog manager: success
I20260808 14:38:09.586887 2878 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b: acquiring CA information for follower catalog manager: success
I20260808 14:38:09.587222 2878 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c0e6829620734b0ca90b7100acfabe7b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:38:09.597201 2894 catalog_manager.cc:1259] Loaded cluster ID: 8611638ae4f64e7881f14c26a5f34c06
I20260808 14:38:09.597272 2894 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8: loading cluster ID for follower catalog manager: success
I20260808 14:38:09.598202 2894 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8: acquiring CA information for follower catalog manager: success
I20260808 14:38:09.598523 2894 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 98cb819df6944428a1907dd3b45801f8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:38:09.804170 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 2603
I20260808 14:38:09.811398 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 2688
I20260808 14:38:09.817368 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 2772
2026-08-08T14:38:09Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2907 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:09 dist-test-slave-8n49 krb5kdc[2931](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:09 dist-test-slave-8n49 krb5kdc[2931](info): set up 2 sockets
Aug 08 14:38:09 dist-test-slave-8n49 krb5kdc[2931](info): commencing operation
krb5kdc: starting...
W20260808 14:38:10.899683 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:38:10 dist-test-slave-8n49 krb5kdc[2931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:38:11.021265 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35499
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:35499
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:11.103541 2945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:11.103741 2945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:11.103763 2945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:11.104852 2945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:11.104888 2945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:11.104902 2945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:11.104915 2945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:11.104928 2945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:11.106334 2945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:35499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:11.106531 2945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:11.106693 2945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:11.111536 2953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:11.111645 2945 server_base.cc:1034] running on GCE node
W20260808 14:38:11.111536 2950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:11.111615 2951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:11.112114 2945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:11.112367 2945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:11.113524 2945 hybrid_clock.cc:648] HybridClock initialized: now 1786199891113505 us; error 40 us; skew 500 ppm
Aug 08 14:38:11 dist-test-slave-8n49 krb5kdc[2931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199891, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:11.120638 2945 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:38:11.121146 2945 webserver.cc:460] Webserver started at http://127.20.81.62:37137/ using document root <none> and password file <none>
I20260808 14:38:11.121388 2945 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:11.121459 2945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:11.121620 2945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:11.122704 2945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "01d50b8d8f684c14b39b72c960dbc3dc"
format_stamp: "Formatted at 2026-08-08 14:38:11 on dist-test-slave-8n49"
server_key: "c0a43ee790324cd52db5c35421ed7719"
server_key_iv: "116d7004fc7648dc41d9dd1bdf80a69b"
server_key_version: "encryptionkey@0"
I20260808 14:38:11.123086 2945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "01d50b8d8f684c14b39b72c960dbc3dc"
format_stamp: "Formatted at 2026-08-08 14:38:11 on dist-test-slave-8n49"
server_key: "c0a43ee790324cd52db5c35421ed7719"
server_key_iv: "116d7004fc7648dc41d9dd1bdf80a69b"
server_key_version: "encryptionkey@0"
I20260808 14:38:11.124486 2945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:38:11.125308 2960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:11.125502 2945 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:11.125624 2945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "01d50b8d8f684c14b39b72c960dbc3dc"
format_stamp: "Formatted at 2026-08-08 14:38:11 on dist-test-slave-8n49"
server_key: "c0a43ee790324cd52db5c35421ed7719"
server_key_iv: "116d7004fc7648dc41d9dd1bdf80a69b"
server_key_version: "encryptionkey@0"
I20260808 14:38:11.125701 2945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:11.144791 2945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:11.147163 2945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:11.147330 2945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:11.151733 2945 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:35499
I20260808 14:38:11.151789 3016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:35499 every 8 connection(s)
I20260808 14:38:11.152169 2945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:11.153185 3017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:11.155441 3017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc: Bootstrap starting.
I20260808 14:38:11.156000 3017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:11.156212 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 2945
I20260808 14:38:11.156329 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:38:11.156369 3017 log.cc:824] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:11.156627 20804 external_mini_cluster.cc:1428] Setting key ea8e14cdba1866ff079fe97e0bc75d33
I20260808 14:38:11.157222 3017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc: No bootstrap required, opened a new log
I20260808 14:38:11.159440 3017 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d50b8d8f684c14b39b72c960dbc3dc" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35499 } }
I20260808 14:38:11.159613 3017 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:11.159667 3017 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01d50b8d8f684c14b39b72c960dbc3dc, State: Initialized, Role: FOLLOWER
I20260808 14:38:11.159794 3017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d50b8d8f684c14b39b72c960dbc3dc" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35499 } }
I20260808 14:38:11.159876 3017 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:11.159899 3017 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:11.159963 3017 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:11.160496 3017 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d50b8d8f684c14b39b72c960dbc3dc" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35499 } }
I20260808 14:38:11.160648 3017 leader_election.cc:302] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01d50b8d8f684c14b39b72c960dbc3dc; no voters:
I20260808 14:38:11.160848 3017 leader_election.cc:288] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:11.160890 3022 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:11.161065 3022 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [term 1 LEADER]: Becoming Leader. State: Replica: 01d50b8d8f684c14b39b72c960dbc3dc, State: Running, Role: LEADER
I20260808 14:38:11.161139 3017 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:11.161526 3022 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d50b8d8f684c14b39b72c960dbc3dc" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35499 } }
I20260808 14:38:11.162003 3023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01d50b8d8f684c14b39b72c960dbc3dc. Latest consensus state: current_term: 1 leader_uuid: "01d50b8d8f684c14b39b72c960dbc3dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d50b8d8f684c14b39b72c960dbc3dc" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35499 } } }
I20260808 14:38:11.162091 3023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:11.162307 3032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:11.162480 3024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01d50b8d8f684c14b39b72c960dbc3dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d50b8d8f684c14b39b72c960dbc3dc" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35499 } } }
I20260808 14:38:11.162866 3032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:11.163015 3024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc [sys.catalog]: This master's current role is: LEADER
Aug 08 14:38:11 dist-test-slave-8n49 krb5kdc[2931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:11.167708 3021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:11.157152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34164 (local address 127.20.81.62:35499)
0808 14:38:11.157335 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:11.157346 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:11.157379 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:38:11.157793 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:11.157800 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:11.157845 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:11.158001 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:11.158637 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:11.159519 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:11.160414 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:11.161098 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:11.161206 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:11.164093 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:11.164096 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:11.164097 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:11.164109 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:11.166133 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:11.166482 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:11.166485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:11.166485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:11.166595 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:11.166789 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:11.166789 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:11.166790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:11.167107 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:11.167269 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:11.167337 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 14:38:11.167478 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260808 14:38:11.168748 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:11.168874 3032 catalog_manager.cc:1347] Generated new cluster ID: d9246c49c5e04dc985ad7447050fa2b6
I20260808 14:38:11.168929 3032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:11.177836 3032 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:11.178365 3032 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:11.185077 3032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01d50b8d8f684c14b39b72c960dbc3dc: Generated new TSK 0
I20260808 14:38:11.185263 3032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:11.222859 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 2945
2026-08-08T14:38:11Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1404 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:11 dist-test-slave-8n49 krb5kdc[3047](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:11 dist-test-slave-8n49 krb5kdc[3047](info): set up 2 sockets
Aug 08 14:38:11 dist-test-slave-8n49 krb5kdc[3047](info): commencing operation
krb5kdc: starting...
W20260808 14:38:12.307562 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:38:12 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:38:12.426882 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33165
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:33165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:12.508337 3061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:12.508605 3061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:12.508656 3061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:12.509814 3061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:12.509886 3061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:12.509909 3061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:12.509938 3061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:12.509967 3061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:12.511421 3061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:33165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:12.511703 3061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:12.511935 3061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:12.516790 3069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:12.516799 3067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:12.517105 3061 server_base.cc:1034] running on GCE node
W20260808 14:38:12.516826 3066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:12.517414 3061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:12.517678 3061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:12.518887 3061 hybrid_clock.cc:648] HybridClock initialized: now 1786199892518870 us; error 31 us; skew 500 ppm
Aug 08 14:38:12 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199892, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:12.521582 3061 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:38:12.522011 3061 webserver.cc:460] Webserver started at http://127.20.81.62:32835/ using document root <none> and password file <none>
I20260808 14:38:12.522234 3061 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:12.522302 3061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:12.522454 3061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:12.523514 3061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "3c00f615c0e942899705081afbbed3d1"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "9eb114d5972ae3056a1fdfff1ded227b"
server_key_iv: "431dd1cce8b953dbc8029ac40d0b3a53"
server_key_version: "encryptionkey@0"
I20260808 14:38:12.523890 3061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "3c00f615c0e942899705081afbbed3d1"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "9eb114d5972ae3056a1fdfff1ded227b"
server_key_iv: "431dd1cce8b953dbc8029ac40d0b3a53"
server_key_version: "encryptionkey@0"
I20260808 14:38:12.525303 3061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:38:12.526057 3076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:12.526255 3061 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:12.526368 3061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "3c00f615c0e942899705081afbbed3d1"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "9eb114d5972ae3056a1fdfff1ded227b"
server_key_iv: "431dd1cce8b953dbc8029ac40d0b3a53"
server_key_version: "encryptionkey@0"
I20260808 14:38:12.526443 3061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:12.537758 3061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:12.539503 3061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:12.539674 3061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:12.543771 3061 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:33165
I20260808 14:38:12.543834 3134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:33165 every 8 connection(s)
I20260808 14:38:12.544184 3061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:12.545231 3135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:12.547533 3135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Bootstrap starting.
I20260808 14:38:12.548120 3135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:12.548422 3135 log.cc:824] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:12.549167 3135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: No bootstrap required, opened a new log
I20260808 14:38:12.550781 3135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:12.550920 3135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:12.550942 3135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c00f615c0e942899705081afbbed3d1, State: Initialized, Role: FOLLOWER
I20260808 14:38:12.551100 3135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:12.551167 3135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:12.551188 3135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:12.551254 3135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:12.551880 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 3061
I20260808 14:38:12.552002 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:38:12.552135 3135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:12.552250 20804 external_mini_cluster.cc:1428] Setting key b49b3effbd00c92f4035f5d537c70851
I20260808 14:38:12.552244 3135 leader_election.cc:302] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c00f615c0e942899705081afbbed3d1; no voters:
I20260808 14:38:12.552408 3135 leader_election.cc:288] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:12.552479 3138 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:12.552687 3138 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 1 LEADER]: Becoming Leader. State: Replica: 3c00f615c0e942899705081afbbed3d1, State: Running, Role: LEADER
I20260808 14:38:12.552814 3138 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:12.552810 3135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:12.553248 3141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c00f615c0e942899705081afbbed3d1. Latest consensus state: current_term: 1 leader_uuid: "3c00f615c0e942899705081afbbed3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } } }
I20260808 14:38:12.553267 3140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c00f615c0e942899705081afbbed3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } } }
I20260808 14:38:12.553335 3141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:12.553354 3140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:12.553596 3145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:12.554226 3145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:12.555912 3145 catalog_manager.cc:1347] Generated new cluster ID: 3798eca9fbd346069b118a87a02171a0
I20260808 14:38:12.555970 3145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:38:12 dist-test-slave-8n49 krb5kdc[3047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:12.564874 3143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:12.552956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34040 (local address 127.20.81.62:33165)
0808 14:38:12.553132 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:12.553141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:12.553177 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:38:12.553582 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:12.553592 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:12.553668 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:12.553829 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:12.554674 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.555938 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.557048 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.557689 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.557813 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:12.560618 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:12.560622 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:12.560623 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:12.560635 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:12.563178 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:12.563603 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:12.563606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:12.563606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:12.563720 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:12.563950 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:12.563950 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:12.563951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:12.564236 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:12.564394 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:12.564497 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 14:38:12.564651 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":96,"threads_started":1}
I20260808 14:38:12.568590 3145 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:12.569106 3145 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:12.576459 3145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Generated new TSK 0
I20260808 14:38:12.576650 3145 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:38:12.607558 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33165
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:12.690106 3164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:12.690331 3164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:12.690369 3164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:12.691532 3164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:12.691599 3164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:12.691646 3164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:38:12.693157 3164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:12.693421 3164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:12.693655 3164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:12.698654 3169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:12.698787 3164 server_base.cc:1034] running on GCE node
W20260808 14:38:12.698665 3170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:12.698855 3172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:12.699121 3164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:12.699370 3164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:12.700591 3164 hybrid_clock.cc:648] HybridClock initialized: now 1786199892700545 us; error 47 us; skew 500 ppm
Aug 08 14:38:12 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199892, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:12.702978 3164 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:38:12.703411 3164 webserver.cc:460] Webserver started at http://127.20.81.1:35351/ using document root <none> and password file <none>
I20260808 14:38:12.703656 3164 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:12.703727 3164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:12.703881 3164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:12.705026 3164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "820457a0782f411694db3e3287ccb2d4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "d677905662291e3c399fc59412fe0642"
server_key_iv: "9175d9370d8436c6993e684ac550133c"
server_key_version: "encryptionkey@0"
I20260808 14:38:12.705396 3164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "820457a0782f411694db3e3287ccb2d4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "d677905662291e3c399fc59412fe0642"
server_key_iv: "9175d9370d8436c6993e684ac550133c"
server_key_version: "encryptionkey@0"
I20260808 14:38:12.706784 3164 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:38:12.707545 3179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:12.707716 3164 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:38:12.707827 3164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "820457a0782f411694db3e3287ccb2d4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "d677905662291e3c399fc59412fe0642"
server_key_iv: "9175d9370d8436c6993e684ac550133c"
server_key_version: "encryptionkey@0"
I20260808 14:38:12.707903 3164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:12.726263 3164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:12.728431 3164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:12.728649 3164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:12.728915 3164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:12.729308 3164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:12.729364 3164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:12.729409 3164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:12.729437 3164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:12.735324 3164 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:35893
I20260808 14:38:12.735369 3305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:35893 every 8 connection(s)
I20260808 14:38:12.735697 3164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:38:12 dist-test-slave-8n49 krb5kdc[3047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199892, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:12.743093 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 3164
I20260808 14:38:12.743216 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:38:12.743443 20804 external_mini_cluster.cc:1428] Setting key fc5dba7c4803341613b5efbe38d42c68
I20260808 14:38:12.745255 3143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:12.736432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:34459 (local address 127.20.81.62:33165)
0808 14:38:12.736516 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:12.736519 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:12.736745 (+ 226us) server_negotiation.cc:407] Connection header received
0808 14:38:12.737282 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:12.737284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:12.737295 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:12.737363 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:12.738381 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.738906 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.739868 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.740067 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.740123 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:12.742297 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:12.742299 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:12.742299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:12.742307 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:12.743799 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:12.744221 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:12.744222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:12.744223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:12.744283 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:12.744576 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:12.744577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:12.744578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:12.744701 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:12.744779 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:12.745074 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 14:38:12.745165 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:38:12.745463 3308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:12.736370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:34459)
0808 14:38:12.736610 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:12.736654 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:12.737167 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:12.737463 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:12.737467 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:12.738066 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:12.738262 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:12.738267 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.738993 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.738994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:12.739785 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:12.739787 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.740145 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.740146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:12.740245 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:12.740794 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:12.740803 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:12.742207 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:12.743887 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:12.743896 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:12.743899 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:12.744139 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:12.744360 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:12.744361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:12.744361 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:12.744474 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:12.744786 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:12.744794 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:12.744935 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 14:38:12.745046 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:38:12.745212 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":93,"threads_started":1}
I20260808 14:38:12.745985 3306 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33165
I20260808 14:38:12.746085 3306 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:12.746294 3306 heartbeater.cc:511] Master 127.20.81.62:33165 requested a full tablet report, sending...
I20260808 14:38:12.746870 3095 ts_manager.cc:194] Registered new tserver with Master: 820457a0782f411694db3e3287ccb2d4 (127.20.81.1:35893)
I20260808 14:38:12.747608 3095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:34459
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:38:12.775436 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33165
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:12.858630 3311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:12.858868 3311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:12.858908 3311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:12.860064 3311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:12.860131 3311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:12.860177 3311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:38:12.861680 3311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:12.861964 3311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:12.862208 3311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:12.867336 3319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:12.867344 3317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:12.867389 3311 server_base.cc:1034] running on GCE node
W20260808 14:38:12.867342 3316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:12.867761 3311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:12.867975 3311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:12.869122 3311 hybrid_clock.cc:648] HybridClock initialized: now 1786199892869085 us; error 60 us; skew 500 ppm
Aug 08 14:38:12 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199892, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:12.871584 3311 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:38:12.872069 3311 webserver.cc:460] Webserver started at http://127.20.81.2:39223/ using document root <none> and password file <none>
I20260808 14:38:12.872305 3311 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:12.872352 3311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:12.872543 3311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:12.873683 3311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "587613d5fcfa475bb18c381249f50ed4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "4a7c0d21eb9539ebd8ad52b329fa4230"
server_key_iv: "acf6b352a2e8980936d78e211938e6fe"
server_key_version: "encryptionkey@0"
I20260808 14:38:12.874058 3311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "587613d5fcfa475bb18c381249f50ed4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "4a7c0d21eb9539ebd8ad52b329fa4230"
server_key_iv: "acf6b352a2e8980936d78e211938e6fe"
server_key_version: "encryptionkey@0"
I20260808 14:38:12.875454 3311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:38:12.876263 3326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:12.876467 3311 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:12.876608 3311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "587613d5fcfa475bb18c381249f50ed4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "4a7c0d21eb9539ebd8ad52b329fa4230"
server_key_iv: "acf6b352a2e8980936d78e211938e6fe"
server_key_version: "encryptionkey@0"
I20260808 14:38:12.876701 3311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:12.892907 3311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:12.894819 3311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:12.894987 3311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:12.895227 3311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:12.895560 3311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:12.895627 3311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:12.895668 3311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:12.895696 3311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:12.901701 3311 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:40163
I20260808 14:38:12.901743 3450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:40163 every 8 connection(s)
I20260808 14:38:12.902092 3311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:38:12 dist-test-slave-8n49 krb5kdc[3047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199892, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:12.910851 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 3311
I20260808 14:38:12.910989 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:38:12.911243 20804 external_mini_cluster.cc:1428] Setting key 6056270bc1bf13c1f287789903d0681a
I20260808 14:38:12.911787 3143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:12.902910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:44347 (local address 127.20.81.62:33165)
0808 14:38:12.902977 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:12.902979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:12.903222 (+ 243us) server_negotiation.cc:407] Connection header received
0808 14:38:12.903740 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:12.903742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:12.903756 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:12.903810 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:12.904831 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.905351 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.906343 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.906544 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.906652 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:12.908752 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:12.908754 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:12.908754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:12.908761 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:12.910164 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:12.910558 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:12.910559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:12.910560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:12.910623 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:12.910862 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:12.910864 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:12.910864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:12.911022 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:12.911120 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:12.911583 (+ 463us) server_negotiation.cc:299] Negotiation successful
0808 14:38:12.911690 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:38:12.911927 3453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:12.902896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:44347)
0808 14:38:12.903105 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:12.903141 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:12.903625 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:12.903880 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:12.903884 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:12.904461 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:12.904734 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:12.904740 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.905451 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.905452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:12.906250 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:12.906252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:12.906662 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:12.906663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:12.906794 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:12.907249 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:12.907258 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:12.908665 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:12.910240 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:12.910246 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:12.910248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:12.910452 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:12.910684 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:12.910684 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:12.910685 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:12.910784 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:12.911127 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:12.911135 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:12.911312 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 14:38:12.911439 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 14:38:12.911661 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":94,"threads_started":1}
I20260808 14:38:12.912389 3451 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33165
I20260808 14:38:12.912493 3451 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:12.912715 3451 heartbeater.cc:511] Master 127.20.81.62:33165 requested a full tablet report, sending...
I20260808 14:38:12.913127 3095 ts_manager.cc:194] Registered new tserver with Master: 587613d5fcfa475bb18c381249f50ed4 (127.20.81.2:40163)
I20260808 14:38:12.913528 3095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:44347
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:38:12.937673 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33165
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:13.020651 3457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:13.020860 3457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:13.020884 3457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:13.021958 3457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:13.022024 3457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:13.022073 3457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:38:13.023509 3457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:13.023696 3457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:13.023871 3457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:38:13.029036 3457 server_base.cc:1034] running on GCE node
W20260808 14:38:13.029009 3463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.029008 3466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.029232 3462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:13.029479 3457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:13.029722 3457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:13.030895 3457 hybrid_clock.cc:648] HybridClock initialized: now 1786199893030865 us; error 42 us; skew 500 ppm
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:13.033608 3457 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:38:13.034086 3457 webserver.cc:460] Webserver started at http://127.20.81.3:35319/ using document root <none> and password file <none>
I20260808 14:38:13.034282 3457 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:13.034332 3457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:13.034425 3457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:13.035432 3457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "db91b4c8731d4dda9d472dd578468de2"
format_stamp: "Formatted at 2026-08-08 14:38:13 on dist-test-slave-8n49"
server_key: "6a2fdb247a80bbbd0db90a05841f11e2"
server_key_iv: "047d52bad018e6666492d7c2578c9dbc"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.035743 3457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "db91b4c8731d4dda9d472dd578468de2"
format_stamp: "Formatted at 2026-08-08 14:38:13 on dist-test-slave-8n49"
server_key: "6a2fdb247a80bbbd0db90a05841f11e2"
server_key_iv: "047d52bad018e6666492d7c2578c9dbc"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.037083 3457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:38:13.037768 3474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.037966 3457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:38:13.038051 3457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "db91b4c8731d4dda9d472dd578468de2"
format_stamp: "Formatted at 2026-08-08 14:38:13 on dist-test-slave-8n49"
server_key: "6a2fdb247a80bbbd0db90a05841f11e2"
server_key_iv: "047d52bad018e6666492d7c2578c9dbc"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.038113 3457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:13.064380 3457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:13.066560 3457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:13.066671 3457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:13.066869 3457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:13.067191 3457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:13.067227 3457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.067274 3457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:13.067301 3457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.072930 3457 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:34155
I20260808 14:38:13.073037 3597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:34155 every 8 connection(s)
I20260808 14:38:13.073334 3457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:13.082315 3143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.074108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:57095 (local address 127.20.81.62:33165)
0808 14:38:13.074190 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.074192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.074348 (+ 156us) server_negotiation.cc:407] Connection header received
0808 14:38:13.074834 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.074835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.074845 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.074897 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:13.075792 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.076303 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.077443 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.077641 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.077729 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.079790 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:13.079792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:13.079792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:13.079799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:13.081168 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.081522 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.081523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.081523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.081572 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.081783 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.081783 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.081783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.081883 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:13.081933 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.082184 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.082251 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:38:13.082466 3601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.074055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:57095)
0808 14:38:13.074233 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.074268 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.074752 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.074949 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.074952 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.075517 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:13.075717 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.075722 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.076412 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.076414 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.077336 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.077339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.077743 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.077744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.077881 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.078335 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:13.078343 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:13.079705 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:13.081240 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.081246 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.081248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.081456 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.081632 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.081633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.081633 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.081728 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.081937 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:13.081941 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:13.082073 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.082156 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.082272 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260808 14:38:13.082970 3598 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33165
I20260808 14:38:13.082989 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 3457
I20260808 14:38:13.083079 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:38:13.083066 3598 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:13.083256 3598 heartbeater.cc:511] Master 127.20.81.62:33165 requested a full tablet report, sending...
I20260808 14:38:13.083262 20804 external_mini_cluster.cc:1428] Setting key 4005f10e50aa91972793202fae353bc8
I20260808 14:38:13.083624 3095 ts_manager.cc:194] Registered new tserver with Master: db91b4c8731d4dda9d472dd578468de2 (127.20.81.3:34155)
I20260808 14:38:13.084084 3095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:57095
I20260808 14:38:13.084249 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:38:13.091270 3143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.085566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34048 (local address 127.20.81.62:33165)
0808 14:38:13.085639 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.085641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.085739 (+ 98us) server_negotiation.cc:407] Connection header received
0808 14:38:13.085802 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.085803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.085813 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.085861 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:13.086404 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.086863 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.087588 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.087780 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.087864 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.088988 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:13.088990 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:13.088990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:13.088997 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:13.090072 (+ 1075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.090427 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.090428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.090429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.090495 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.090702 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.090703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.090703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.090844 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:13.090949 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.091099 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.091175 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:38:13.092777 3095 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:38:13.094540 3095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:38:13.100749 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.096739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:34155 (local address 127.0.0.1:33014)
0808 14:38:13.096996 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.097039 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.097139 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.097354 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.097357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.097359 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:13.097425 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.097427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.098461 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.098462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.099446 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.099449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.100424 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.100425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.100480 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.100489 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.100620 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.100677 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"spinlock_wait_cycles":384,"thread_start_us":81,"threads_started":1}
I20260808 14:38:13.100747 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.096808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33014 (local address 127.20.81.3:34155)
0808 14:38:13.097010 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.097015 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.097120 (+ 105us) server_negotiation.cc:407] Connection header received
0808 14:38:13.097228 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.097230 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.097249 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.097336 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:13.097513 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.098361 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.099545 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.100246 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.100319 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.100384 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.100617 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.100662 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
I20260808 14:38:13.101483 3611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.096739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35893 (local address 127.0.0.1:38398)
0808 14:38:13.097094 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.097103 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.097146 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.097776 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.097777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.097780 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:13.097837 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.097839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.099133 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.099134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.100077 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.100079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.101255 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.101256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.101322 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.101327 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.101360 (+ 33us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.101400 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":46,"thread_start_us":61,"threads_started":1}
I20260808 14:38:13.101712 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.096946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:40163 (local address 127.0.0.1:58806)
0808 14:38:13.097380 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.097391 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.097471 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.097757 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.097758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.097761 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:13.097808 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.097810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.099130 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.099131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.100293 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.100297 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.101460 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.101461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.101525 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.101529 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.101585 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.101632 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":28,"thread_start_us":73,"threads_started":1}
I20260808 14:38:13.101866 3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.096919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38398 (local address 127.20.81.1:35893)
0808 14:38:13.097600 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.097605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.097614 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:38:13.097654 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.097656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.097670 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.097775 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:13.097907 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.099002 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.100167 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.101138 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.101610 (+ 472us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.101695 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.101724 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.101773 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":85,"threads_started":1}
I20260808 14:38:13.101806 3526 tablet_service.cc:1467] Processing CreateTablet for tablet acfa0df9750640e9b13cc5d3b665d081 (DEFAULT_TABLE table=test-table [id=be4cbdd9097146ac99dd1e6e811c1bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:13.101938 3616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.097193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58806 (local address 127.20.81.2:40163)
0808 14:38:13.097382 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.097386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.097533 (+ 147us) server_negotiation.cc:407] Connection header received
0808 14:38:13.097583 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.097585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.097601 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.097676 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:13.097886 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.099024 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.100377 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.101390 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.101459 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.101513 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.101819 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.101863 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":89,"threads_started":1}
I20260808 14:38:13.102200 3526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acfa0df9750640e9b13cc5d3b665d081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:13.102535 3378 tablet_service.cc:1467] Processing CreateTablet for tablet acfa0df9750640e9b13cc5d3b665d081 (DEFAULT_TABLE table=test-table [id=be4cbdd9097146ac99dd1e6e811c1bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:13.102524 3235 tablet_service.cc:1467] Processing CreateTablet for tablet acfa0df9750640e9b13cc5d3b665d081 (DEFAULT_TABLE table=test-table [id=be4cbdd9097146ac99dd1e6e811c1bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:13.102792 3378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acfa0df9750640e9b13cc5d3b665d081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:13.102851 3235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acfa0df9750640e9b13cc5d3b665d081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:13.105353 3617 tablet_bootstrap.cc:492] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: Bootstrap starting.
I20260808 14:38:13.106007 3617 tablet_bootstrap.cc:654] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:13.106161 3618 tablet_bootstrap.cc:492] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: Bootstrap starting.
I20260808 14:38:13.106330 3619 tablet_bootstrap.cc:492] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Bootstrap starting.
I20260808 14:38:13.106702 3617 log.cc:824] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:13.106812 3618 tablet_bootstrap.cc:654] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:13.107038 3619 tablet_bootstrap.cc:654] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:13.107410 3618 log.cc:824] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:13.107532 3619 log.cc:824] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:13.107657 3617 tablet_bootstrap.cc:492] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: No bootstrap required, opened a new log
I20260808 14:38:13.107733 3617 ts_tablet_manager.cc:1397] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:13.108280 3619 tablet_bootstrap.cc:492] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: No bootstrap required, opened a new log
I20260808 14:38:13.108353 3619 ts_tablet_manager.cc:1397] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:13.109031 3618 tablet_bootstrap.cc:492] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: No bootstrap required, opened a new log
I20260808 14:38:13.109113 3618 ts_tablet_manager.cc:1397] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:38:13.109907 3617 raft_consensus.cc:348] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.110096 3617 raft_consensus.cc:374] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:13.110134 3617 raft_consensus.cc:729] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 587613d5fcfa475bb18c381249f50ed4, State: Initialized, Role: FOLLOWER
I20260808 14:38:13.110273 3617 consensus_queue.cc:260] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.110371 3619 raft_consensus.cc:348] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.110544 3619 raft_consensus.cc:374] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:13.110570 3617 ts_tablet_manager.cc:1428] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:13.110610 3619 raft_consensus.cc:729] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 820457a0782f411694db3e3287ccb2d4, State: Initialized, Role: FOLLOWER
I20260808 14:38:13.110728 3619 consensus_queue.cc:260] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.110769 3451 heartbeater.cc:503] Master 127.20.81.62:33165 was elected leader, sending a full tablet report...
I20260808 14:38:13.110739 3618 raft_consensus.cc:348] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.110898 3618 raft_consensus.cc:374] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:13.110935 3618 raft_consensus.cc:729] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db91b4c8731d4dda9d472dd578468de2, State: Initialized, Role: FOLLOWER
I20260808 14:38:13.110994 3619 ts_tablet_manager.cc:1428] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:13.111043 3618 consensus_queue.cc:260] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.111138 3306 heartbeater.cc:503] Master 127.20.81.62:33165 was elected leader, sending a full tablet report...
I20260808 14:38:13.111320 3618 ts_tablet_manager.cc:1428] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:13.111332 3598 heartbeater.cc:503] Master 127.20.81.62:33165 was elected leader, sending a full tablet report...
W20260808 14:38:13.152693 3452 tablet.cc:2369] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:38:13.173985 3624 raft_consensus.cc:482] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:38:13.174120 3624 raft_consensus.cc:504] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.174548 3624 leader_election.cc:288] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db91b4c8731d4dda9d472dd578468de2 (127.20.81.3:34155), 587613d5fcfa475bb18c381249f50ed4 (127.20.81.2:40163)
I20260808 14:38:13.178582 3616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.174838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:37843 (local address 127.20.81.2:40163)
0808 14:38:13.174894 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.174903 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.174913 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:38:13.174947 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.174948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.174961 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.175019 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:13.175275 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.176067 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.177550 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.178164 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.178248 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.178260 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.178466 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.178506 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:38:13.178582 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.174926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:41849 (local address 127.20.81.3:34155)
0808 14:38:13.174994 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.174996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.175250 (+ 254us) server_negotiation.cc:407] Connection header received
0808 14:38:13.175285 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.175287 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.175301 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.175372 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:13.175517 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.176202 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.177550 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.178168 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.178248 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.178259 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.178461 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.178505 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:38:13.178598 3308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.174760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:40163 (local address 127.20.81.1:37843)
0808 14:38:13.174809 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.174822 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.174866 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.175034 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.175036 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.175038 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:13.175159 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.175163 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.176149 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.176150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.177419 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.177423 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.178273 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.178274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.178368 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.178370 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.178435 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.178481 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":3}
I20260808 14:38:13.178606 3626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.174760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:34155 (local address 127.20.81.1:41849)
0808 14:38:13.175135 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.175146 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.175214 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.175382 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.175383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.175384 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:13.175437 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.175439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.176276 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.176276 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.177452 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.177454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.178273 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.178274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.178363 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.178367 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.178442 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.178480 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":166,"thread_start_us":141,"threads_started":1}
I20260808 14:38:13.179042 3401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acfa0df9750640e9b13cc5d3b665d081" candidate_uuid: "820457a0782f411694db3e3287ccb2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "587613d5fcfa475bb18c381249f50ed4" is_pre_election: true
I20260808 14:38:13.179248 3401 raft_consensus.cc:2454] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820457a0782f411694db3e3287ccb2d4 in term 0.
I20260808 14:38:13.179276 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acfa0df9750640e9b13cc5d3b665d081" candidate_uuid: "820457a0782f411694db3e3287ccb2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db91b4c8731d4dda9d472dd578468de2" is_pre_election: true
I20260808 14:38:13.179431 3548 raft_consensus.cc:2454] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820457a0782f411694db3e3287ccb2d4 in term 0.
I20260808 14:38:13.179539 3182 leader_election.cc:302] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 587613d5fcfa475bb18c381249f50ed4, 820457a0782f411694db3e3287ccb2d4; no voters:
I20260808 14:38:13.179723 3624 raft_consensus.cc:2781] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:38:13.179766 3624 raft_consensus.cc:482] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:38:13.179782 3624 raft_consensus.cc:3037] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:13.180521 3624 raft_consensus.cc:504] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.180757 3624 leader_election.cc:288] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [CANDIDATE]: Term 1 election: Requested vote from peers db91b4c8731d4dda9d472dd578468de2 (127.20.81.3:34155), 587613d5fcfa475bb18c381249f50ed4 (127.20.81.2:40163)
I20260808 14:38:13.180930 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acfa0df9750640e9b13cc5d3b665d081" candidate_uuid: "820457a0782f411694db3e3287ccb2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db91b4c8731d4dda9d472dd578468de2"
I20260808 14:38:13.180948 3401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acfa0df9750640e9b13cc5d3b665d081" candidate_uuid: "820457a0782f411694db3e3287ccb2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "587613d5fcfa475bb18c381249f50ed4"
I20260808 14:38:13.181015 3548 raft_consensus.cc:3037] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:13.181015 3401 raft_consensus.cc:3037] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:13.181906 3401 raft_consensus.cc:2454] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 820457a0782f411694db3e3287ccb2d4 in term 1.
I20260808 14:38:13.181906 3548 raft_consensus.cc:2454] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 820457a0782f411694db3e3287ccb2d4 in term 1.
I20260808 14:38:13.182116 3182 leader_election.cc:302] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 587613d5fcfa475bb18c381249f50ed4, 820457a0782f411694db3e3287ccb2d4; no voters:
I20260808 14:38:13.182219 3624 raft_consensus.cc:2781] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:13.182391 3624 raft_consensus.cc:686] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 1 LEADER]: Becoming Leader. State: Replica: 820457a0782f411694db3e3287ccb2d4, State: Running, Role: LEADER
I20260808 14:38:13.182530 3624 consensus_queue.cc:237] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.183442 3095 catalog_manager.cc:5495] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 820457a0782f411694db3e3287ccb2d4 (127.20.81.1). New cstate: current_term: 1 leader_uuid: "820457a0782f411694db3e3287ccb2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } health_report { overall_health: UNKNOWN } } }
I20260808 14:38:13.192823 3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.190589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38412 (local address 127.20.81.1:35893)
0808 14:38:13.190644 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.190646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.190678 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:38:13.190707 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.190707 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.190724 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.190773 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:13.190903 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.191348 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.192061 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.192237 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.192285 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.192442 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:13.192545 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:13.192658 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.192695 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.192711 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:38:13.194491 3548 raft_consensus.cc:1261] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [term 1 FOLLOWER]: Refusing update from remote peer 820457a0782f411694db3e3287ccb2d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:13.194591 3401 raft_consensus.cc:1261] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [term 1 FOLLOWER]: Refusing update from remote peer 820457a0782f411694db3e3287ccb2d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:13.194818 3627 consensus_queue.cc:1035] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:13.194936 3624 consensus_queue.cc:1035] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:13.197521 3633 mvcc.cc:205] Tried to move back new op lower bound from 7316274762522075136 to 7316274762476331008. Current Snapshot: MvccSnapshot[applied={T|T < 7316274762522075136}]
I20260808 14:38:13.198254 3632 mvcc.cc:205] Tried to move back new op lower bound from 7316274762522075136 to 7316274762476331008. Current Snapshot: MvccSnapshot[applied={T|T < 7316274762522075136}]
I20260808 14:38:13.200248 3094 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:13.200340 3094 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:13.201181 3094 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Sending DeleteTablet for 3 replicas of tablet acfa0df9750640e9b13cc5d3b665d081
I20260808 14:38:13.201522 3235 tablet_service.cc:1514] Processing DeleteTablet for tablet acfa0df9750640e9b13cc5d3b665d081 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:13 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:38398
I20260808 14:38:13.201534 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet acfa0df9750640e9b13cc5d3b665d081 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:13 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:33014
I20260808 14:38:13.201573 3378 tablet_service.cc:1514] Processing DeleteTablet for tablet acfa0df9750640e9b13cc5d3b665d081 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:13 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:58806
I20260808 14:38:13.201622 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 3164
I20260808 14:38:13.202605 3641 tablet_replica.cc:330] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: stopping tablet replica
I20260808 14:38:13.202690 3641 raft_consensus.cc:2229] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:13.202776 3641 raft_consensus.cc:2258] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:13.202855 3643 tablet_replica.cc:330] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: stopping tablet replica
I20260808 14:38:13.202970 3643 raft_consensus.cc:2229] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:13.203231 3643 raft_consensus.cc:2258] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:13.203275 3641 ts_tablet_manager.cc:1905] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:13.203853 3643 ts_tablet_manager.cc:1905] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:13.205348 3641 ts_tablet_manager.cc:1918] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:13.205430 3641 log.cc:1196] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/acfa0df9750640e9b13cc5d3b665d081
I20260808 14:38:13.205668 3643 ts_tablet_manager.cc:1918] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:13.205708 3641 ts_tablet_manager.cc:1939] T acfa0df9750640e9b13cc5d3b665d081 P db91b4c8731d4dda9d472dd578468de2: Deleting consensus metadata
I20260808 14:38:13.205770 3643 log.cc:1196] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/acfa0df9750640e9b13cc5d3b665d081
I20260808 14:38:13.206027 3643 ts_tablet_manager.cc:1939] T acfa0df9750640e9b13cc5d3b665d081 P 587613d5fcfa475bb18c381249f50ed4: Deleting consensus metadata
I20260808 14:38:13.206286 3077 catalog_manager.cc:4841] TS db91b4c8731d4dda9d472dd578468de2 (127.20.81.3:34155): tablet acfa0df9750640e9b13cc5d3b665d081 (table test-table [id=be4cbdd9097146ac99dd1e6e811c1bf2]) successfully deleted
I20260808 14:38:13.206624 3080 catalog_manager.cc:4841] TS 587613d5fcfa475bb18c381249f50ed4 (127.20.81.2:40163): tablet acfa0df9750640e9b13cc5d3b665d081 (table test-table [id=be4cbdd9097146ac99dd1e6e811c1bf2]) successfully deleted
W20260808 14:38:13.209935 3080 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:35893 (error 108)
I20260808 14:38:13.210050 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 3311
I20260808 14:38:13.211148 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.210990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35893 (local address 127.0.0.1:38420)
0808 14:38:13.211056 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.211104 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 14:38:13.211297 3080 catalog_manager.cc:4584] TS 820457a0782f411694db3e3287ccb2d4 (127.20.81.1:35893): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet acfa0df9750640e9b13cc5d3b665d081: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35893: connect: Connection refused (error 111)
I20260808 14:38:13.216356 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 3457
I20260808 14:38:13.221895 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 3061
I20260808 14:38:13.229650 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33165
--webserver_interface=127.20.81.62
--webserver_port=32835
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:33165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:13.312978 3646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:13.313190 3646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:13.313215 3646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:13.314451 3646 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:13.314492 3646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:13.314507 3646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:13.314519 3646 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:13.314532 3646 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:13.316022 3646 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:33165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=32835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:13.316293 3646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:13.316538 3646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:13.327107 3652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.327061 3655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:13.327199 3646 server_base.cc:1034] running on GCE node
W20260808 14:38:13.327061 3653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:13.327729 3646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:13.328030 3646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:13.329169 3646 hybrid_clock.cc:648] HybridClock initialized: now 1786199893329166 us; error 40 us; skew 500 ppm
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:13.331750 3646 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:38:13.332223 3646 webserver.cc:460] Webserver started at http://127.20.81.62:32835/ using document root <none> and password file <none>
I20260808 14:38:13.332502 3646 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:13.332626 3646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:13.334012 3646 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:13.334786 3662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.334976 3646 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:13.335074 3646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "3c00f615c0e942899705081afbbed3d1"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "9eb114d5972ae3056a1fdfff1ded227b"
server_key_iv: "431dd1cce8b953dbc8029ac40d0b3a53"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.335500 3646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:13.349555 3646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:13.352000 3646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:13.352180 3646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:13.356493 3646 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:33165
I20260808 14:38:13.356531 3717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:33165 every 8 connection(s)
I20260808 14:38:13.356982 3646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:13.358732 3718 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:38:13.359362 3718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Bootstrap starting.
I20260808 14:38:13.364950 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 3646
I20260808 14:38:13.365304 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:35893
--local_ip_for_outbound_sockets=127.20.81.1
--tserver_master_addrs=127.20.81.62:33165
--webserver_port=35351
--webserver_interface=127.20.81.1
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:13.369026 3718 log.cc:824] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:13.372030 3718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:38:13.372440 3718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Bootstrap complete.
I20260808 14:38:13.376845 3718 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:13.377267 3718 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c00f615c0e942899705081afbbed3d1, State: Initialized, Role: FOLLOWER
I20260808 14:38:13.377519 3718 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:13.377617 3718 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:13.377684 3718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:13.377738 3718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:38:13.379315 3718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:13.379432 3718 leader_election.cc:302] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c00f615c0e942899705081afbbed3d1; no voters:
I20260808 14:38:13.379604 3718 leader_election.cc:288] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:38:13.379769 3724 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:38:13.379853 3718 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:13.379961 3724 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 2 LEADER]: Becoming Leader. State: Replica: 3c00f615c0e942899705081afbbed3d1, State: Running, Role: LEADER
I20260808 14:38:13.380067 3724 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:13.380436 3725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3c00f615c0e942899705081afbbed3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } } }
I20260808 14:38:13.380520 3725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:13.380617 3724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c00f615c0e942899705081afbbed3d1. Latest consensus state: current_term: 2 leader_uuid: "3c00f615c0e942899705081afbbed3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } } }
I20260808 14:38:13.380668 3724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:13.380883 3735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:13.381671 3735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:13.381765 3735 catalog_manager.cc:1259] Loaded cluster ID: 3798eca9fbd346069b118a87a02171a0
I20260808 14:38:13.381791 3735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:13.382308 3735 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 14:38:13.387143 3735 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 14:38:13.389775 3735 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:13.390012 3735 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Loaded TSK: 0
I20260808 14:38:13.390228 3735 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:38:13.453480 3722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:13.453672 3722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:13.453696 3722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:13.454878 3722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:13.454921 3722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:13.454947 3722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:38:13.456403 3722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:35893
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=35351
--tserver_master_addrs=127.20.81.62:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:13.456672 3722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:13.456928 3722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:13.461946 3752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.461988 3751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.461966 3754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:13.462234 3722 server_base.cc:1034] running on GCE node
I20260808 14:38:13.462430 3722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:13.462687 3722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:13.463855 3722 hybrid_clock.cc:648] HybridClock initialized: now 1786199893463842 us; error 32 us; skew 500 ppm
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:13.466550 3722 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:38:13.467073 3722 webserver.cc:460] Webserver started at http://127.20.81.1:35351/ using document root <none> and password file <none>
I20260808 14:38:13.467361 3722 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:13.467447 3722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:13.468863 3722 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:13.469581 3761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.469786 3722 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:13.469899 3722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "820457a0782f411694db3e3287ccb2d4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "d677905662291e3c399fc59412fe0642"
server_key_iv: "9175d9370d8436c6993e684ac550133c"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.470268 3722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:13.482208 3722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:13.484506 3722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:13.484695 3722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:13.484989 3722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:13.485519 3768 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:38:13.486974 3722 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:38:13.487032 3722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:38:13.487066 3722 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:38:13.487730 3722 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:38:13.487773 3722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:13.487824 3768 tablet_bootstrap.cc:492] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Bootstrap starting.
I20260808 14:38:13.496397 3722 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:35893
I20260808 14:38:13.496834 3886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:35893 every 8 connection(s)
I20260808 14:38:13.496970 3722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:38:13.499409 3768 log.cc:824] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:13.501720 3768 tablet_bootstrap.cc:492] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:38:13.502067 3768 tablet_bootstrap.cc:492] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Bootstrap complete.
I20260808 14:38:13.502209 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 3722
I20260808 14:38:13.502471 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:40163
--local_ip_for_outbound_sockets=127.20.81.2
--tserver_master_addrs=127.20.81.62:33165
--webserver_port=39223
--webserver_interface=127.20.81.2
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:13.503261 3768 ts_tablet_manager.cc:1397] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.009s
I20260808 14:38:13.504901 3768 raft_consensus.cc:348] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.505216 3768 raft_consensus.cc:729] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 820457a0782f411694db3e3287ccb2d4, State: Initialized, Role: FOLLOWER
I20260808 14:38:13.505354 3768 consensus_queue.cc:260] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } }
I20260808 14:38:13.505612 3768 ts_tablet_manager.cc:1428] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:13.513821 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.497843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:37619 (local address 127.20.81.62:33165)
0808 14:38:13.501788 (+ 3945us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.501799 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.501844 (+ 45us) server_negotiation.cc:407] Connection header received
0808 14:38:13.501999 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.502006 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.502062 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.503068 (+ 1006us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:13.503156 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.504515 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.505964 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.506618 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.506731 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.509673 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:13.509677 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:13.509678 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:13.509691 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:13.511690 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.512240 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.512243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.512243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.512354 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.512714 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.512716 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.512716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.513023 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:13.513126 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.513500 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.513639 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3876,"thread_start_us":93,"threads_started":1}
I20260808 14:38:13.513899 3889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.497713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:37619)
0808 14:38:13.497962 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.498000 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.498576 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.502262 (+ 3686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.502267 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.502644 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:13.502924 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.502930 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.504641 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.504643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.505848 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.505851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.506723 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.506725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.506878 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.507546 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:13.507557 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:13.509558 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:13.511786 (+ 2228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.511795 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.511798 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.512142 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.512441 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.512441 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.512442 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.512626 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.513120 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:13.513128 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:13.513303 (+ 175us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.513434 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.513646 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":86,"threads_started":1}
I20260808 14:38:13.515571 3887 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33165
I20260808 14:38:13.515664 3887 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:13.515839 3887 heartbeater.cc:511] Master 127.20.81.62:33165 requested a full tablet report, sending...
I20260808 14:38:13.516669 3679 ts_manager.cc:194] Registered new tserver with Master: 820457a0782f411694db3e3287ccb2d4 (127.20.81.1:35893)
I20260808 14:38:13.517805 3679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:37619
I20260808 14:38:13.518711 3887 heartbeater.cc:503] Master 127.20.81.62:33165 was elected leader, sending a full tablet report...
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.1@KRBTEST.COM
I20260808 14:38:13.525813 3896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.517299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35893 (local address 127.0.0.1:38434)
0808 14:38:13.517576 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.517613 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.517686 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.517883 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.517886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.518219 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:13.518292 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.518295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.519530 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.519531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.520081 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.520083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.520706 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.520707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.520765 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.521227 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:13.521231 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:13.522673 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:13.524725 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.524732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.524734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.524940 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.525161 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.525162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.525162 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.525219 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.525530 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:13.525536 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:13.525579 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.525657 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.525746 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":92,"threads_started":1}
I20260808 14:38:13.525882 3897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.517392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38434 (local address 127.20.81.1:35893)
0808 14:38:13.517577 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.517583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.517685 (+ 102us) server_negotiation.cc:407] Connection header received
0808 14:38:13.517773 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.517775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.517790 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.517861 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:13.518376 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.519448 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.520158 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.520629 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.520699 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.522762 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:13.522770 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:13.522771 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:13.522778 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:13.524626 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.525026 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.525029 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.525029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.525092 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.525280 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.525280 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.525281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.525446 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:13.525553 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.525696 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.525789 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":152,"thread_start_us":98,"threads_started":1}
I20260808 14:38:13.526548 3792 tablet_service.cc:1514] Processing DeleteTablet for tablet acfa0df9750640e9b13cc5d3b665d081 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:13 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:38434
I20260808 14:38:13.527154 3898 tablet_replica.cc:330] stopping tablet replica
I20260808 14:38:13.527271 3898 raft_consensus.cc:2229] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:13.527360 3898 raft_consensus.cc:2258] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:13.527680 3898 ts_tablet_manager.cc:1905] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:13.529946 3898 ts_tablet_manager.cc:1918] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:13.530014 3898 log.cc:1196] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/acfa0df9750640e9b13cc5d3b665d081
I20260808 14:38:13.530253 3898 ts_tablet_manager.cc:1939] T acfa0df9750640e9b13cc5d3b665d081 P 820457a0782f411694db3e3287ccb2d4: Deleting consensus metadata
I20260808 14:38:13.530753 3665 catalog_manager.cc:4841] TS 820457a0782f411694db3e3287ccb2d4 (127.20.81.1:35893): tablet acfa0df9750640e9b13cc5d3b665d081 (table test-table [id=be4cbdd9097146ac99dd1e6e811c1bf2]) successfully deleted
W20260808 14:38:13.593393 3894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:13.593617 3894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:13.593658 3894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:13.594795 3894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:13.594858 3894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:13.594904 3894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:38:13.596323 3894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:40163
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=39223
--tserver_master_addrs=127.20.81.62:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:13.596625 3894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:13.596863 3894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:13.601869 3905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.601970 3907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:13.602020 3894 server_base.cc:1034] running on GCE node
W20260808 14:38:13.602190 3903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:13.602475 3894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:13.602679 3894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:13.603822 3894 hybrid_clock.cc:648] HybridClock initialized: now 1786199893603796 us; error 48 us; skew 500 ppm
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:13.606480 3894 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:38:13.606971 3894 webserver.cc:460] Webserver started at http://127.20.81.2:39223/ using document root <none> and password file <none>
I20260808 14:38:13.607162 3894 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:13.607218 3894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:13.608645 3894 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:13.609220 3916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.609395 3894 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:38:13.609506 3894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "587613d5fcfa475bb18c381249f50ed4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "4a7c0d21eb9539ebd8ad52b329fa4230"
server_key_iv: "acf6b352a2e8980936d78e211938e6fe"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.609879 3894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:13.626581 3894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:13.628707 3894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:13.628873 3894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:13.629114 3894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:13.629482 3894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:13.629549 3894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.629601 3894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:13.629633 3894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.635824 3894 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:40163
I20260808 14:38:13.635874 4039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:40163 every 8 connection(s)
I20260808 14:38:13.636250 3894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:38:13.639593 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 3894
I20260808 14:38:13.639894 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:34155
--local_ip_for_outbound_sockets=127.20.81.3
--tserver_master_addrs=127.20.81.62:33165
--webserver_port=35319
--webserver_interface=127.20.81.3
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:13.647347 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.637092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:54553 (local address 127.20.81.62:33165)
0808 14:38:13.637166 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.637169 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.637409 (+ 240us) server_negotiation.cc:407] Connection header received
0808 14:38:13.637904 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.637905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.637920 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.637973 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:13.639026 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.639611 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.641178 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.641394 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.641498 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.643782 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:13.643784 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:13.643785 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:13.643793 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:13.645698 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.646159 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.646160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.646160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.646235 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.646525 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.646527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.646527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.646689 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:13.646773 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.647098 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.647206 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:38:13.647369 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.637087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:54553)
0808 14:38:13.637284 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.637322 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.637819 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.638061 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.638065 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.638738 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:13.638929 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.638934 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.639730 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.639732 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.641074 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.641077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.641536 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.641538 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.641696 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.642240 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:13.642249 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:13.643684 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:13.645803 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.645810 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.645812 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.646070 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.646315 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.646316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.646316 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.646447 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.646805 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:13.646812 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:13.646948 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.647046 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.647189 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
I20260808 14:38:13.648082 4040 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33165
I20260808 14:38:13.648211 4040 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:13.648447 4040 heartbeater.cc:511] Master 127.20.81.62:33165 requested a full tablet report, sending...
I20260808 14:38:13.649003 3679 ts_manager.cc:194] Registered new tserver with Master: 587613d5fcfa475bb18c381249f50ed4 (127.20.81.2:40163)
I20260808 14:38:13.649571 3679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:54553
W20260808 14:38:13.724812 4044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:13.725034 4044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:13.725059 4044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:13.726163 4044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:13.726200 4044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:13.726226 4044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:38:13.727717 4044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:34155
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=35319
--tserver_master_addrs=127.20.81.62:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:13.727929 4044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:13.728122 4044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:13.733098 4051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.733084 4054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.733094 4052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:13.733421 4044 server_base.cc:1034] running on GCE node
I20260808 14:38:13.733654 4044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:13.733896 4044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:13.735066 4044 hybrid_clock.cc:648] HybridClock initialized: now 1786199893735051 us; error 33 us; skew 500 ppm
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:13.737548 4044 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:38:13.738075 4044 webserver.cc:460] Webserver started at http://127.20.81.3:35319/ using document root <none> and password file <none>
I20260808 14:38:13.738327 4044 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:13.738433 4044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:13.739913 4044 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:38:13.740526 4061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.740767 4044 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:13.740869 4044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "db91b4c8731d4dda9d472dd578468de2"
format_stamp: "Formatted at 2026-08-08 14:38:13 on dist-test-slave-8n49"
server_key: "6a2fdb247a80bbbd0db90a05841f11e2"
server_key_iv: "047d52bad018e6666492d7c2578c9dbc"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.741247 4044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:13.752182 4044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:13.754292 4044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:13.754472 4044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:13.754711 4044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:13.755036 4044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:13.755091 4044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.755134 4044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:13.755162 4044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.761113 4044 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:34155
I20260808 14:38:13.761180 4183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:34155 every 8 connection(s)
I20260808 14:38:13.761556 4044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:38:13.765857 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 4044
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:13.771443 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.762457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:49713 (local address 127.20.81.62:33165)
0808 14:38:13.762541 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.762544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.762735 (+ 191us) server_negotiation.cc:407] Connection header received
0808 14:38:13.763215 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.763216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.763226 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.763284 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:13.764248 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.764864 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.765860 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.766155 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.766225 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.768444 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:13.768445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:13.768446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:13.768454 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:13.769973 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.770402 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.770403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.770404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.770467 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.770734 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.770735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.770735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.770853 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:13.770924 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.771222 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.771353 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:38:13.771584 4187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.762413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:49713)
0808 14:38:13.762600 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.762643 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.763131 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.763354 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.763358 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.763942 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:13.764134 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.764138 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.764949 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.764950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.765763 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.765765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.766308 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.766309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.766460 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.766983 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:13.766993 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:13.768339 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:13.770081 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.770089 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.770091 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.770320 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.770543 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:13.770544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:13.770544 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:13.770657 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:13.770929 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:13.770936 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:13.771081 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.771186 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.771353 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260808 14:38:13.772066 4184 heartbeater.cc:347] Connected to a master server at 127.20.81.62:33165
I20260808 14:38:13.772154 4184 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:13.772382 4184 heartbeater.cc:511] Master 127.20.81.62:33165 requested a full tablet report, sending...
I20260808 14:38:13.772909 3679 ts_manager.cc:194] Registered new tserver with Master: db91b4c8731d4dda9d472dd578468de2 (127.20.81.3:34155)
I20260808 14:38:13.773047 4189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.766291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34064 (local address 127.20.81.62:33165)
0808 14:38:13.766416 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.766418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.766434 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:38:13.766512 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.766513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.766525 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.766582 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:13.767271 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.767761 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.768593 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.768801 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.768875 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.770017 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:13.770019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:13.770019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:13.770026 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:13.771574 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.772056 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.772057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.772057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.772111 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.772373 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.772373 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.772374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.772538 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:13.772758 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.772878 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.772963 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260808 14:38:13.773380 3679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:49713
I20260808 14:38:13.773762 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:38:13.776507 4189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.774288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34080 (local address 127.20.81.62:33165)
0808 14:38:13.774323 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.774324 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.774330 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:38:13.774356 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.774357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.774384 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.774468 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:13.774566 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.775019 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.775749 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.775960 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.776034 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.776195 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:13.776293 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:13.776386 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.776405 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.776434 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:38:13.776803 3679 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:34080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:38:13.778307 3679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:38:13.780503 3792 tablet_service.cc:1467] Processing CreateTablet for tablet 10607507ac5942f39559621c8454483e (DEFAULT_TABLE table=test-table [id=8387077388694b38b831b0f7bf674135]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:13.780763 3792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10607507ac5942f39559621c8454483e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:13.782579 3768 tablet_bootstrap.cc:492] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: Bootstrap starting.
I20260808 14:38:13.782958 3768 tablet_bootstrap.cc:654] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:13.783542 3768 tablet_bootstrap.cc:492] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: No bootstrap required, opened a new log
I20260808 14:38:13.783591 3768 ts_tablet_manager.cc:1397] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:13.783934 3768 raft_consensus.cc:348] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } }
I20260808 14:38:13.784004 3768 raft_consensus.cc:374] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:13.784058 3768 raft_consensus.cc:729] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 820457a0782f411694db3e3287ccb2d4, State: Initialized, Role: FOLLOWER
I20260808 14:38:13.784108 3768 consensus_queue.cc:260] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } }
I20260808 14:38:13.784219 3768 ts_tablet_manager.cc:1428] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:13.784636 4191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.780192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:34155 (local address 127.0.0.1:33022)
0808 14:38:13.780500 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.780512 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.780583 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.780844 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.780845 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.780848 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:13.780895 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.780896 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.781912 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.781913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.783060 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.783272 (+ 212us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.784305 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.784306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.784381 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.784403 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.784489 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.784542 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":108,"threads_started":1}
I20260808 14:38:13.784646 4193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.780426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33022 (local address 127.20.81.3:34155)
0808 14:38:13.780656 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.780661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.780673 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:38:13.780711 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.780713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.780729 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.780815 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:13.780957 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.781824 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.783366 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.784130 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.784203 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.784266 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.784515 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.784573 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":115,"threads_started":1}
I20260808 14:38:13.785391 4111 tablet_service.cc:1467] Processing CreateTablet for tablet 10607507ac5942f39559621c8454483e (DEFAULT_TABLE table=test-table [id=8387077388694b38b831b0f7bf674135]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:13.785758 4111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10607507ac5942f39559621c8454483e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:13.785960 3896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.780130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:40163 (local address 127.0.0.1:58822)
0808 14:38:13.780182 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.780193 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.780230 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.782762 (+ 2532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.782763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.782764 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:13.782804 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.782806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.783840 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.783841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.784983 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.784986 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.785703 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.785704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.785792 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.785796 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.785851 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.785900 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:38:13.786006 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.780294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58822 (local address 127.20.81.2:40163)
0808 14:38:13.782609 (+ 2315us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.782614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.782624 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:38:13.782662 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.782664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.782679 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.782760 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:13.782866 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.783731 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.785057 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.785613 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.785693 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.785750 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.785884 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.785923 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2278,"thread_start_us":96,"threads_started":1}
I20260808 14:38:13.786612 3969 tablet_service.cc:1467] Processing CreateTablet for tablet 10607507ac5942f39559621c8454483e (DEFAULT_TABLE table=test-table [id=8387077388694b38b831b0f7bf674135]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:13.786909 3969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10607507ac5942f39559621c8454483e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:13.788796 4195 tablet_bootstrap.cc:492] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: Bootstrap starting.
I20260808 14:38:13.789388 4195 tablet_bootstrap.cc:654] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:13.789746 4196 tablet_bootstrap.cc:492] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: Bootstrap starting.
I20260808 14:38:13.790009 4195 log.cc:824] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:13.790547 4196 tablet_bootstrap.cc:654] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:13.790844 4195 tablet_bootstrap.cc:492] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: No bootstrap required, opened a new log
I20260808 14:38:13.790928 4195 ts_tablet_manager.cc:1397] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:13.791126 4196 log.cc:824] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:13.791913 4196 tablet_bootstrap.cc:492] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: No bootstrap required, opened a new log
I20260808 14:38:13.791992 4196 ts_tablet_manager.cc:1397] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:13.792943 4195 raft_consensus.cc:348] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } }
I20260808 14:38:13.793111 4195 raft_consensus.cc:374] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:13.793146 4195 raft_consensus.cc:729] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db91b4c8731d4dda9d472dd578468de2, State: Initialized, Role: FOLLOWER
I20260808 14:38:13.793267 4195 consensus_queue.cc:260] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } }
I20260808 14:38:13.793561 4195 ts_tablet_manager.cc:1428] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:38:13.793604 4184 heartbeater.cc:503] Master 127.20.81.62:33165 was elected leader, sending a full tablet report...
I20260808 14:38:13.794016 4196 raft_consensus.cc:348] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } }
I20260808 14:38:13.794193 4196 raft_consensus.cc:374] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:13.794230 4196 raft_consensus.cc:729] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 587613d5fcfa475bb18c381249f50ed4, State: Initialized, Role: FOLLOWER
I20260808 14:38:13.794342 4196 consensus_queue.cc:260] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } }
I20260808 14:38:13.794658 4040 heartbeater.cc:503] Master 127.20.81.62:33165 was elected leader, sending a full tablet report...
I20260808 14:38:13.794879 4196 ts_tablet_manager.cc:1428] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:13.808643 3895 raft_consensus.cc:482] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:38:13.808789 3895 raft_consensus.cc:504] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } }
I20260808 14:38:13.809121 3895 leader_election.cc:288] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 587613d5fcfa475bb18c381249f50ed4 (127.20.81.2:40163), db91b4c8731d4dda9d472dd578468de2 (127.20.81.3:34155)
I20260808 14:38:13.812137 4193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.809378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:54571 (local address 127.20.81.3:34155)
0808 14:38:13.809531 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.809534 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.809580 (+ 46us) server_negotiation.cc:407] Connection header received
0808 14:38:13.809641 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.809642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.809661 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.809726 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:13.809902 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.810365 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.811341 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.811737 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.811819 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.811831 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.812022 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.812065 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260808 14:38:13.812156 3889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.809299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:40163 (local address 127.20.81.1:46697)
0808 14:38:13.809365 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.809377 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.809430 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.809609 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.809611 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.809613 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:13.809691 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.809694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.810381 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.810382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.811252 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.811255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.811855 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.811856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.811955 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.811964 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.812039 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.812077 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":102}
I20260808 14:38:13.812167 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.809381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:46697 (local address 127.20.81.2:40163)
0808 14:38:13.809464 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.809466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.809478 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:38:13.809506 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.809507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.809519 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.809588 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:13.809763 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.810294 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.811369 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.811747 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.811833 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.811844 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.812058 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.812100 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:38:13.812182 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.809299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:34155 (local address 127.20.81.1:54571)
0808 14:38:13.809505 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.809516 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:13.809578 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:13.809754 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:13.809756 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:13.809757 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:13.809837 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.809839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.810453 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.810454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.811251 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:13.811253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.811845 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.811847 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:13.811932 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.811951 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 14:38:13.811995 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:38:13.812059 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":26,"thread_start_us":113,"threads_started":1}
I20260808 14:38:13.812518 4133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10607507ac5942f39559621c8454483e" candidate_uuid: "820457a0782f411694db3e3287ccb2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db91b4c8731d4dda9d472dd578468de2" is_pre_election: true
I20260808 14:38:13.812513 3990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10607507ac5942f39559621c8454483e" candidate_uuid: "820457a0782f411694db3e3287ccb2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "587613d5fcfa475bb18c381249f50ed4" is_pre_election: true
I20260808 14:38:13.812688 4133 raft_consensus.cc:2454] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820457a0782f411694db3e3287ccb2d4 in term 0.
I20260808 14:38:13.812692 3990 raft_consensus.cc:2454] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820457a0782f411694db3e3287ccb2d4 in term 0.
I20260808 14:38:13.812875 3762 leader_election.cc:302] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 820457a0782f411694db3e3287ccb2d4, db91b4c8731d4dda9d472dd578468de2; no voters:
I20260808 14:38:13.813036 3895 raft_consensus.cc:2781] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:38:13.813120 3895 raft_consensus.cc:482] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:38:13.813156 3895 raft_consensus.cc:3037] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:13.813943 3895 raft_consensus.cc:504] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } }
I20260808 14:38:13.814122 3895 leader_election.cc:288] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [CANDIDATE]: Term 1 election: Requested vote from peers 587613d5fcfa475bb18c381249f50ed4 (127.20.81.2:40163), db91b4c8731d4dda9d472dd578468de2 (127.20.81.3:34155)
I20260808 14:38:13.814265 4133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10607507ac5942f39559621c8454483e" candidate_uuid: "820457a0782f411694db3e3287ccb2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db91b4c8731d4dda9d472dd578468de2"
I20260808 14:38:13.814277 3990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10607507ac5942f39559621c8454483e" candidate_uuid: "820457a0782f411694db3e3287ccb2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "587613d5fcfa475bb18c381249f50ed4"
I20260808 14:38:13.814350 3990 raft_consensus.cc:3037] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:13.814360 4133 raft_consensus.cc:3037] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:13.815038 3990 raft_consensus.cc:2454] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 820457a0782f411694db3e3287ccb2d4 in term 1.
I20260808 14:38:13.815152 4133 raft_consensus.cc:2454] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 820457a0782f411694db3e3287ccb2d4 in term 1.
I20260808 14:38:13.815238 3764 leader_election.cc:302] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 587613d5fcfa475bb18c381249f50ed4, 820457a0782f411694db3e3287ccb2d4; no voters:
I20260808 14:38:13.815393 3895 raft_consensus.cc:2781] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:13.815577 3895 raft_consensus.cc:686] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 1 LEADER]: Becoming Leader. State: Replica: 820457a0782f411694db3e3287ccb2d4, State: Running, Role: LEADER
I20260808 14:38:13.815661 3895 consensus_queue.cc:237] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } }
I20260808 14:38:13.816388 3679 catalog_manager.cc:5495] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 820457a0782f411694db3e3287ccb2d4 (127.20.81.1). New cstate: current_term: 1 leader_uuid: "820457a0782f411694db3e3287ccb2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "820457a0782f411694db3e3287ccb2d4" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35893 } health_report { overall_health: HEALTHY } } }
I20260808 14:38:13.829730 3897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.827546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38450 (local address 127.20.81.1:35893)
0808 14:38:13.827620 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.827622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.827631 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:38:13.827677 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.827678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.827694 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.827754 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:13.827870 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.828378 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.829096 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.829292 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.829343 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.829468 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:13.829563 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:13.829624 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.829655 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.829673 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:38:13.831300 4133 raft_consensus.cc:1261] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [term 1 FOLLOWER]: Refusing update from remote peer 820457a0782f411694db3e3287ccb2d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:13.831641 3990 raft_consensus.cc:1261] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [term 1 FOLLOWER]: Refusing update from remote peer 820457a0782f411694db3e3287ccb2d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:13.831713 4202 consensus_queue.cc:1035] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db91b4c8731d4dda9d472dd578468de2" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:13.831905 3895 consensus_queue.cc:1035] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "587613d5fcfa475bb18c381249f50ed4" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:13.834590 4205 mvcc.cc:205] Tried to move back new op lower bound from 7316274765130301440 to 7316274765069471744. Current Snapshot: MvccSnapshot[applied={T|T < 7316274765130301440}]
I20260808 14:38:13.836225 3678 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:34080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:13.836318 3678 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:34080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:13.836927 4207 mvcc.cc:205] Tried to move back new op lower bound from 7316274765130301440 to 7316274765069471744. Current Snapshot: MvccSnapshot[applied={T|T < 7316274765130301440}]
I20260808 14:38:13.837651 3792 tablet_service.cc:1514] Processing DeleteTablet for tablet 10607507ac5942f39559621c8454483e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:13 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:38434
I20260808 14:38:13.837790 3898 tablet_replica.cc:330] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: stopping tablet replica
I20260808 14:38:13.837755 3969 tablet_service.cc:1514] Processing DeleteTablet for tablet 10607507ac5942f39559621c8454483e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:13 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:58822
I20260808 14:38:13.837854 3898 raft_consensus.cc:2229] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:38:13.837960 3898 raft_consensus.cc:2258] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:13.838090 3678 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Sending DeleteTablet for 3 replicas of tablet 10607507ac5942f39559621c8454483e
I20260808 14:38:13.838285 3898 ts_tablet_manager.cc:1905] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:13.838413 4111 tablet_service.cc:1514] Processing DeleteTablet for tablet 10607507ac5942f39559621c8454483e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:13 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:33022
I20260808 14:38:13.838645 4215 tablet_replica.cc:330] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: stopping tablet replica
I20260808 14:38:13.838779 4215 raft_consensus.cc:2229] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:13.838820 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 3722
I20260808 14:38:13.839003 4215 raft_consensus.cc:2258] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:13.839411 4214 tablet_replica.cc:330] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: stopping tablet replica
I20260808 14:38:13.839507 4214 raft_consensus.cc:2229] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:13.839596 4214 raft_consensus.cc:2258] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:13.840148 4214 ts_tablet_manager.cc:1905] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:13.840445 4215 ts_tablet_manager.cc:1905] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:13.841871 4214 ts_tablet_manager.cc:1918] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:13.841955 4214 log.cc:1196] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/10607507ac5942f39559621c8454483e
I20260808 14:38:13.842010 3969 tablet_service.cc:1514] Processing DeleteTablet for tablet 10607507ac5942f39559621c8454483e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:13 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:58822
I20260808 14:38:13.842284 4214 ts_tablet_manager.cc:1939] T 10607507ac5942f39559621c8454483e P 587613d5fcfa475bb18c381249f50ed4: Deleting consensus metadata
I20260808 14:38:13.842361 4215 ts_tablet_manager.cc:1918] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:13.842435 4215 log.cc:1196] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/10607507ac5942f39559621c8454483e
I20260808 14:38:13.842738 4215 ts_tablet_manager.cc:1939] T 10607507ac5942f39559621c8454483e P db91b4c8731d4dda9d472dd578468de2: Deleting consensus metadata
W20260808 14:38:13.842967 3665 catalog_manager.cc:4808] TS 587613d5fcfa475bb18c381249f50ed4 (127.20.81.2:40163): delete failed for tablet 10607507ac5942f39559621c8454483e because the tablet was not found. No further retry: Not found: Tablet not found: 10607507ac5942f39559621c8454483e
I20260808 14:38:13.844975 3663 catalog_manager.cc:4841] TS db91b4c8731d4dda9d472dd578468de2 (127.20.81.3:34155): tablet 10607507ac5942f39559621c8454483e (table test-table [id=8387077388694b38b831b0f7bf674135]) successfully deleted
W20260808 14:38:13.849375 3665 connection.cc:535] client connection to 127.20.81.1:35893 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 14:38:13.849486 3665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:38:13.849628 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 3894
I20260808 14:38:13.852106 3896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.851961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35893 (local address 127.0.0.1:38466)
0808 14:38:13.852027 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:13.852073 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 14:38:13.852293 3665 catalog_manager.cc:4584] TS 820457a0782f411694db3e3287ccb2d4 (127.20.81.1:35893): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 10607507ac5942f39559621c8454483e: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35893: connect: Connection refused (error 111)
I20260808 14:38:13.855763 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 4044
I20260808 14:38:13.863045 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 3646
I20260808 14:38:13.869549 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33165
--webserver_interface=127.20.81.62
--webserver_port=32835
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:33165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:13.954079 4217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:13.954293 4217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:13.954314 4217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:13.955505 4217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:13.955550 4217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:13.955564 4217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:13.955578 4217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:13.955590 4217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:13.957113 4217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:33165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=32835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:13.957371 4217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:13.957630 4217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:13.962625 4223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.962673 4222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.962639 4225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:13.962877 4217 server_base.cc:1034] running on GCE node
I20260808 14:38:13.963151 4217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:13.963459 4217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:13.964628 4217 hybrid_clock.cc:648] HybridClock initialized: now 1786199893964606 us; error 36 us; skew 500 ppm
Aug 08 14:38:13 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:13.967139 4217 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:38:13.967593 4217 webserver.cc:460] Webserver started at http://127.20.81.62:32835/ using document root <none> and password file <none>
I20260808 14:38:13.967825 4217 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:13.967872 4217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:13.969343 4217 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:13.970013 4233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.970209 4217 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:38:13.970301 4217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "3c00f615c0e942899705081afbbed3d1"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "9eb114d5972ae3056a1fdfff1ded227b"
server_key_iv: "431dd1cce8b953dbc8029ac40d0b3a53"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.970662 4217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:13.989210 4217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:13.991133 4217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:13.991259 4217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:13.995584 4217 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:33165
I20260808 14:38:13.995635 4289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:33165 every 8 connection(s)
I20260808 14:38:13.996035 4217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:13.997700 4290 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:38:13.998302 4290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Bootstrap starting.
I20260808 14:38:14.004931 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 4217
I20260808 14:38:14.005249 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:35893
--local_ip_for_outbound_sockets=127.20.81.1
--tserver_master_addrs=127.20.81.62:33165
--webserver_port=35351
--webserver_interface=127.20.81.1
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:14.007261 4290 log.cc:824] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:14.009727 4290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:38:14.010036 4290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1: Bootstrap complete.
I20260808 14:38:14.012303 4290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:14.012586 4290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c00f615c0e942899705081afbbed3d1, State: Initialized, Role: FOLLOWER
I20260808 14:38:14.012780 4290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:14.012864 4290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:14.012918 4290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:14.012966 4290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:38:14.013937 4290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:14.014060 4290 leader_election.cc:302] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c00f615c0e942899705081afbbed3d1; no voters:
I20260808 14:38:14.014276 4290 leader_election.cc:288] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:38:14.014312 4294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:38:14.014426 4294 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [term 3 LEADER]: Becoming Leader. State: Replica: 3c00f615c0e942899705081afbbed3d1, State: Running, Role: LEADER
I20260808 14:38:14.014532 4294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } }
I20260808 14:38:14.014570 4290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:14.014824 4294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c00f615c0e942899705081afbbed3d1. Latest consensus state: current_term: 3 leader_uuid: "3c00f615c0e942899705081afbbed3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } } }
I20260808 14:38:14.014889 4294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:14.015095 4296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3c00f615c0e942899705081afbbed3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c00f615c0e942899705081afbbed3d1" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33165 } } }
I20260808 14:38:14.015194 4296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c00f615c0e942899705081afbbed3d1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:14.015208 4299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:14.016084 4299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:14.016204 4299 catalog_manager.cc:1259] Loaded cluster ID: 3798eca9fbd346069b118a87a02171a0
I20260808 14:38:14.016253 4299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 14:38:14.016813 4299 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f34bdb5f9ad google::LogMessage::Fail() at ??:0
@ 0x7f34bdb6288a google::LogMessage::SendToLog() at ??:0
@ 0x7f34bdb5f4de google::LogMessage::Flush() at ??:0
@ 0x7f34bdb60a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f34c5a800f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f34c5a898b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f34bfa2d0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f34bfa22954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f34c08866db start_thread at ??:0
@ 0x7f34bc65d61f clone at ??:0
W20260808 14:38:14.102505 4292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:14.102715 4292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:14.102739 4292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:14.104018 4292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:14.104066 4292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:14.104094 4292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:38:14.105662 4292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:35893
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=35351
--tserver_master_addrs=127.20.81.62:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:14.105937 4292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:14.106185 4292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:14.111321 4329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:14.111325 4328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:14.111613 4292 server_base.cc:1034] running on GCE node
W20260808 14:38:14.111814 4331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:14.112010 4292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:14.112264 4292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:14.113448 4292 hybrid_clock.cc:648] HybridClock initialized: now 1786199894113431 us; error 32 us; skew 500 ppm
Aug 08 14:38:14 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199894, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:14.116252 4292 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:38:14.116820 4292 webserver.cc:460] Webserver started at http://127.20.81.1:35351/ using document root <none> and password file <none>
I20260808 14:38:14.117102 4292 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:14.117185 4292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:14.118723 4292 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:38:14.119555 4340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:14.119762 4292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:14.119876 4292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "820457a0782f411694db3e3287ccb2d4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "d677905662291e3c399fc59412fe0642"
server_key_iv: "9175d9370d8436c6993e684ac550133c"
server_key_version: "encryptionkey@0"
I20260808 14:38:14.120291 4292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:14.130244 4292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:14.132623 4292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:14.132800 4292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:14.133049 4292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:14.133523 4347 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260808 14:38:14.135500 4347 ts_tablet_manager.cc:1852] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 14:38:14.135949 4347 ts_tablet_manager.cc:1905] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:14.138481 4347 ts_tablet_manager.cc:1918] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:14.138581 4347 log.cc:1196] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/10607507ac5942f39559621c8454483e
I20260808 14:38:14.138887 4347 ts_tablet_manager.cc:1939] T 10607507ac5942f39559621c8454483e P 820457a0782f411694db3e3287ccb2d4: Deleting consensus metadata
I20260808 14:38:14.139145 4292 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 14:38:14.139207 4292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 14:38:14.139273 4292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:14.139304 4292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:14.146839 4292 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:35893
I20260808 14:38:14.146926 4462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:35893 every 8 connection(s)
I20260808 14:38:14.147228 4292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:38:14.151510 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 4292
I20260808 14:38:14.151820 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:40163
--local_ip_for_outbound_sockets=127.20.81.2
--tserver_master_addrs=127.20.81.62:33165
--webserver_port=39223
--webserver_interface=127.20.81.2
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:14.201210 4465 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:14.148030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:59557)
0808 14:38:14.148201 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:14.148245 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:14.148810 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:14.200989 (+ 52179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
W20260808 14:38:14.201527 4463 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:33165 (0 consecutive failures): Network error: Failed to ping master at 127.20.81.62:33165: Client connection negotiation failed: client connection to 127.20.81.62:33165: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:38:14.201931 4465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:14.201806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:54511)
0808 14:38:14.201864 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:14.201907 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:38:14.202278 4465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:14.202188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:41851)
0808 14:38:14.202235 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:14.202261 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 14:38:14.202425 4463 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:38:14.236474 4466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:14.236750 4466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:14.236775 4466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:14.237919 4466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:14.237969 4466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:14.237994 4466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:38:14.239459 4466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:40163
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=39223
--tserver_master_addrs=127.20.81.62:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:14.239711 4466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:14.239945 4466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:14.245031 4472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:14.245038 4473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:14.245059 4475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:14.245345 4466 server_base.cc:1034] running on GCE node
I20260808 14:38:14.245572 4466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:14.245808 4466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:14.246981 4466 hybrid_clock.cc:648] HybridClock initialized: now 1786199894246959 us; error 30 us; skew 500 ppm
Aug 08 14:38:14 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199894, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:14.249539 4466 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:38:14.249922 4466 webserver.cc:460] Webserver started at http://127.20.81.2:39223/ using document root <none> and password file <none>
I20260808 14:38:14.250123 4466 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:14.250164 4466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:14.251395 4466 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:14.251941 4482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:14.252120 4466 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:38:14.252228 4466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "587613d5fcfa475bb18c381249f50ed4"
format_stamp: "Formatted at 2026-08-08 14:38:12 on dist-test-slave-8n49"
server_key: "4a7c0d21eb9539ebd8ad52b329fa4230"
server_key_iv: "acf6b352a2e8980936d78e211938e6fe"
server_key_version: "encryptionkey@0"
I20260808 14:38:14.252687 4466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:14.275933 4466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:14.278049 4466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:14.278221 4466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:14.278475 4466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:14.278822 4466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:14.278874 4466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:14.278941 4466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:14.278980 4466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:14.285250 4466 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:40163
I20260808 14:38:14.285305 4611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:40163 every 8 connection(s)
I20260808 14:38:14.285691 4466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:38:14.286753 4614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:14.286364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:47679)
0808 14:38:14.286525 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:14.286610 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
W20260808 14:38:14.287158 4612 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:33165 (0 consecutive failures): Network error: Failed to ping master at 127.20.81.62:33165: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
I20260808 14:38:14.287436 4614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:14.287347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:46139)
0808 14:38:14.287392 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:14.287419 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:38:14.287707 4614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:14.287657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:47695)
0808 14:38:14.287678 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:14.287695 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260808 14:38:14.287817 4612 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:38:14.288436 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 4466
I20260808 14:38:14.288717 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:34155
--local_ip_for_outbound_sockets=127.20.81.3
--tserver_master_addrs=127.20.81.62:33165
--webserver_port=35319
--webserver_interface=127.20.81.3
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:14.373157 4615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:14.373366 4615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:14.373390 4615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:14.374625 4615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:14.374672 4615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:14.374724 4615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:38:14.376187 4615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:34155
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=35319
--tserver_master_addrs=127.20.81.62:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:14.376425 4615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:14.376710 4615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:14.381702 4624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:14.381757 4621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:14.381709 4620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:14.381894 4615 server_base.cc:1034] running on GCE node
I20260808 14:38:14.382085 4615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:14.382324 4615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:14.383468 4615 hybrid_clock.cc:648] HybridClock initialized: now 1786199894383450 us; error 40 us; skew 500 ppm
Aug 08 14:38:14 dist-test-slave-8n49 krb5kdc[3047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199894, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:14.386219 4615 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:38:14.386687 4615 webserver.cc:460] Webserver started at http://127.20.81.3:35319/ using document root <none> and password file <none>
I20260808 14:38:14.386921 4615 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:14.386970 4615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:14.388358 4615 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:14.389104 4631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:14.389328 4615 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:14.389403 4615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "db91b4c8731d4dda9d472dd578468de2"
format_stamp: "Formatted at 2026-08-08 14:38:13 on dist-test-slave-8n49"
server_key: "6a2fdb247a80bbbd0db90a05841f11e2"
server_key_iv: "047d52bad018e6666492d7c2578c9dbc"
server_key_version: "encryptionkey@0"
I20260808 14:38:14.389777 4615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:14.401530 4615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:14.403877 4615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:14.404050 4615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:14.404294 4615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:14.404675 4615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:14.404713 4615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:14.404736 4615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:14.404778 4615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:14.410759 4615 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:34155
I20260808 14:38:14.410809 4751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:34155 every 8 connection(s)
I20260808 14:38:14.411152 4615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:38:14.412209 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:14.411825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:51735)
0808 14:38:14.411990 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:14.412072 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
W20260808 14:38:14.412675 4752 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:33165 (0 consecutive failures): Network error: Failed to ping master at 127.20.81.62:33165: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
I20260808 14:38:14.412952 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:14.412855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:58515)
0808 14:38:14.412905 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:14.412930 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 14:38:14.413235 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:14.413151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:47419)
0808 14:38:14.413195 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:14.413216 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 14:38:14.413347 4752 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:38:14.414265 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 4615
I20260808 14:38:15.203063 4756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:15.202798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:33233)
0808 14:38:15.202941 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:15.202985 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":66,"threads_started":1}
I20260808 14:38:15.288290 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:15.288107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:46593)
0808 14:38:15.288215 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:15.288246 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":59,"threads_started":1}
I20260808 14:38:15.413880 4758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:15.413659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:33679)
0808 14:38:15.413794 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:15.413827 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
I20260808 14:38:16.204272 4759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:16.203930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:34915)
0808 14:38:16.204138 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:16.204198 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":111,"threads_started":1}
I20260808 14:38:16.289004 4761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:16.288783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:40195)
0808 14:38:16.288930 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:16.288964 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":79,"threads_started":1}
I20260808 14:38:16.414577 4762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:16.414328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:55313)
0808 14:38:16.414492 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:16.414532 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":79,"threads_started":1}
I20260808 14:38:17.205189 4763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:17.204918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:38871)
0808 14:38:17.205100 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:17.205139 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":87,"threads_started":1}
I20260808 14:38:17.289707 4764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:17.289462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:52467)
0808 14:38:17.289627 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:17.289663 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":64,"threads_started":1}
I20260808 14:38:17.415352 4765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:17.415095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:42565)
0808 14:38:17.415259 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:17.415301 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":65,"threads_started":1}
I20260808 14:38:18.205969 4766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:18.205717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:50435)
0808 14:38:18.205871 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:18.205908 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":87,"threads_started":1}
I20260808 14:38:18.290422 4767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:18.290208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:39399)
0808 14:38:18.290341 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:18.290377 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260808 14:38:18.416152 4769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:18.415901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:41209)
0808 14:38:18.416067 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:18.416105 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":115,"threads_started":1}
I20260808 14:38:19.206794 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:19.206517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:56811)
0808 14:38:19.206703 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:19.206745 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":90,"threads_started":1}
I20260808 14:38:19.291266 4771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:19.291022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:39899)
0808 14:38:19.291176 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:19.291220 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260808 14:38:19.416944 4772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:19.416718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:41617)
0808 14:38:19.416851 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:19.416892 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":67,"threads_started":1}
I20260808 14:38:20.207604 4773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:20.207345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:55647)
0808 14:38:20.207505 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:20.207545 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":76,"threads_started":1}
I20260808 14:38:20.292088 4775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:20.291821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:37951)
0808 14:38:20.292005 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:20.292043 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":95,"threads_started":1}
I20260808 14:38:20.417768 4776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:20.417523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:59757)
0808 14:38:20.417668 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:20.417712 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260808 14:38:21.208496 4777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:21.208197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:39161)
0808 14:38:21.208391 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:21.208444 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":106,"threads_started":1}
I20260808 14:38:21.292937 4778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:21.292633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:53567)
0808 14:38:21.292813 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:21.292874 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":75,"threads_started":1}
I20260808 14:38:21.418510 4779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:21.418226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:48955)
0808 14:38:21.418404 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:21.418448 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":88,"threads_started":1}
I20260808 14:38:22.209197 4780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:22.208980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:46773)
0808 14:38:22.209111 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:22.209147 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260808 14:38:22.293628 4781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:22.293369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:54493)
0808 14:38:22.293541 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:22.293578 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":65,"threads_started":1}
I20260808 14:38:22.419332 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:22.419056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:46919)
0808 14:38:22.419237 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:22.419266 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":108,"threads_started":1}
I20260808 14:38:23.209968 4783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:23.209696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:58333)
0808 14:38:23.209870 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:23.209916 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":76,"threads_started":1}
I20260808 14:38:23.294350 4784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:23.294119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:57545)
0808 14:38:23.294263 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:23.294299 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260808 14:38:23.420310 4785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:23.420020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:44479)
0808 14:38:23.420178 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:23.420245 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":80,"threads_started":1}
I20260808 14:38:24.210777 4786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:24.210501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:44677)
0808 14:38:24.210681 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:24.210725 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":70,"threads_started":1}
I20260808 14:38:24.295100 4787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:24.294857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:33335)
0808 14:38:24.295006 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:24.295051 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":66,"threads_started":1}
I20260808 14:38:24.421175 4788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:24.420925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:59809)
0808 14:38:24.421082 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:24.421124 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260808 14:38:25.211594 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:25.211350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:55537)
0808 14:38:25.211494 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:25.211533 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":70,"threads_started":1}
I20260808 14:38:25.295892 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:25.295652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:37915)
0808 14:38:25.295802 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:25.295842 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":67,"threads_started":1}
I20260808 14:38:25.421984 4792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:25.421729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:58303)
0808 14:38:25.421898 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:25.421936 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":114,"threads_started":1}
I20260808 14:38:26.212468 4794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:26.212167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:51827)
0808 14:38:26.212349 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:26.212387 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":93,"threads_started":1}
I20260808 14:38:26.296684 4795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:26.296410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:42401)
0808 14:38:26.296541 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:26.296637 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260808 14:38:26.422724 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:26.422481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:42923)
0808 14:38:26.422631 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:26.422673 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":85,"threads_started":1}
I20260808 14:38:27.213364 4798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:27.213119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:37117)
0808 14:38:27.213271 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:27.213314 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":72,"threads_started":1}
I20260808 14:38:27.297478 4799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:27.297231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:47883)
0808 14:38:27.297377 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:27.297424 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
I20260808 14:38:27.423612 4800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:27.423346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:49943)
0808 14:38:27.423520 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:27.423565 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":63,"threads_started":1}
I20260808 14:38:28.214111 4801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:28.213882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:40687)
0808 14:38:28.214016 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:28.214058 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260808 14:38:28.298259 4802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:28.298027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:59837)
0808 14:38:28.298171 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:28.298210 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":72,"threads_started":1}
I20260808 14:38:28.424325 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:28.424087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:41485)
0808 14:38:28.424233 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:28.424274 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":66,"threads_started":1}
I20260808 14:38:29.214900 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:29.214649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.1:44233)
0808 14:38:29.214809 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:29.214847 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":68,"threads_started":1}
I20260808 14:38:29.298995 4806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:29.298780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.2:51217)
0808 14:38:29.298912 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:29.298945 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":78,"threads_started":1}
I20260808 14:38:29.422710 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 4292
I20260808 14:38:29.425591 4807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:29.425242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:33165 (local address 127.20.81.3:38385)
0808 14:38:29.425479 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:29.425527 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":159,"threads_started":1}
I20260808 14:38:29.429733 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 4466
I20260808 14:38:29.437104 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 4615
2026-08-08T14:38:29Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18215 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:29 dist-test-slave-8n49 krb5kdc[4810](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:29 dist-test-slave-8n49 krb5kdc[4810](info): set up 2 sockets
Aug 08 14:38:29 dist-test-slave-8n49 krb5kdc[4810](info): commencing operation
krb5kdc: starting...
W20260808 14:38:30.532619 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:38:30 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:38:30.659485 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34269
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:34269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:30.741618 4824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:30.741840 4824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:30.741864 4824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:30.742970 4824 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:38:30.743005 4824 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:38:30.743016 4824 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:38:30.743028 4824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:30.743041 4824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:30.743053 4824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:30.743065 4824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:30.743077 4824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:30.744484 4824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:34269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:30.744700 4824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:30.744874 4824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:30.750051 4832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:30.749971 4829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:30.750128 4830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:30.750197 4824 server_base.cc:1034] running on GCE node
I20260808 14:38:30.750603 4824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:30.750842 4824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:30.752022 4824 hybrid_clock.cc:648] HybridClock initialized: now 1786199910752011 us; error 28 us; skew 500 ppm
Aug 08 14:38:30 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199910, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:30.754580 4824 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:38:30.755059 4824 webserver.cc:460] Webserver started at http://127.20.81.62:43821/ using document root <none> and password file <none>
I20260808 14:38:30.755285 4824 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:30.755353 4824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:30.755508 4824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:30.756660 4824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "8c4bf6da0dc1469681a3640a73b7b5a6"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "3cd65683cfd407c4dc779c9731824ceb"
server_key_iv: "57a0151599e44b045d384776ee169314"
server_key_version: "encryptionkey@0"
I20260808 14:38:30.757040 4824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "8c4bf6da0dc1469681a3640a73b7b5a6"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "3cd65683cfd407c4dc779c9731824ceb"
server_key_iv: "57a0151599e44b045d384776ee169314"
server_key_version: "encryptionkey@0"
I20260808 14:38:30.758596 4824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:38:30.759374 4842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:30.759585 4824 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:30.759706 4824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "8c4bf6da0dc1469681a3640a73b7b5a6"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "3cd65683cfd407c4dc779c9731824ceb"
server_key_iv: "57a0151599e44b045d384776ee169314"
server_key_version: "encryptionkey@0"
I20260808 14:38:30.759789 4824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:30.806581 4824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:30.808537 4824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:30.808749 4824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:30.812858 4824 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:34269
I20260808 14:38:30.812917 4897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:34269 every 8 connection(s)
I20260808 14:38:30.813315 4824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:30.814211 4898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:30.815062 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 4824
I20260808 14:38:30.815188 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:38:30.815403 20804 external_mini_cluster.cc:1428] Setting key 16fc7ca9e5fe2deef65db6bd1ba866c1
I20260808 14:38:30.817603 4898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Bootstrap starting.
I20260808 14:38:30.818369 4898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:30.818672 4898 log.cc:824] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:30.819403 4898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: No bootstrap required, opened a new log
I20260808 14:38:30.821802 4898 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:38:30.821985 4898 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:30.822041 4898 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c4bf6da0dc1469681a3640a73b7b5a6, State: Initialized, Role: FOLLOWER
I20260808 14:38:30.822184 4898 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:38:30.822269 4898 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:30.822304 4898 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:30.822355 4898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 14:38:30 dist-test-slave-8n49 krb5kdc[4810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:30.823076 4898 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:38:30.823218 4898 leader_election.cc:302] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c4bf6da0dc1469681a3640a73b7b5a6; no voters:
I20260808 14:38:30.823428 4898 leader_election.cc:288] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:30.823489 4903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:30.823663 4903 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 1 LEADER]: Becoming Leader. State: Replica: 8c4bf6da0dc1469681a3640a73b7b5a6, State: Running, Role: LEADER
I20260808 14:38:30.823731 4898 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:30.823765 4903 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:38:30.824095 4903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c4bf6da0dc1469681a3640a73b7b5a6. Latest consensus state: current_term: 1 leader_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } } }
I20260808 14:38:30.824179 4903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:30.824321 4904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } } }
I20260808 14:38:30.824389 4904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:30.824536 4909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:30.825942 4909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:30.827257 4901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:30.815978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40164 (local address 127.20.81.62:34269)
0808 14:38:30.816180 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:30.816190 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:30.816223 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:38:30.816796 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:30.816806 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:30.816874 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:30.817030 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:30.817644 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:30.819023 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:30.819818 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:30.820433 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:30.820588 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:30.823174 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:30.823178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:30.823179 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:30.823192 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:30.825525 (+ 2333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:30.825943 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:30.825946 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:30.825946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:30.826089 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:30.826341 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:30.826342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:30.826343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:30.826580 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:30.826757 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:30.826896 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 14:38:30.827056 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260808 14:38:30.828930 4909 catalog_manager.cc:1347] Generated new cluster ID: 196768c129fc482795b2839ced083d9d
I20260808 14:38:30.828984 4909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:30.841370 4909 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:30.842126 4909 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:30.847528 4909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Generated new TSK 0
I20260808 14:38:30.847711 4909 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:38:30.879076 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34269
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:30.962061 4924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:30.962260 4924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:30.962284 4924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:30.963551 4924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:30.963614 4924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:30.963645 4924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:38:30.965148 4924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:30.965389 4924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:30.965637 4924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:30.970640 4937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:30.970646 4932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:30.970649 4935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:30.970892 4924 server_base.cc:1034] running on GCE node
I20260808 14:38:30.971114 4924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:30.971350 4924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:30.972496 4924 hybrid_clock.cc:648] HybridClock initialized: now 1786199910972478 us; error 37 us; skew 500 ppm
Aug 08 14:38:30 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199910, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:30.975068 4924 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:38:30.975498 4924 webserver.cc:460] Webserver started at http://127.20.81.1:32775/ using document root <none> and password file <none>
I20260808 14:38:30.975728 4924 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:30.975796 4924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:30.975958 4924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:30.977099 4924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "9fab53c5aa1143dfb439a1b436df1185"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "825b1e25ad37192299ac2aeb17cc8a93"
server_key_iv: "c5f6de88b283e96deb4ff564cdb0001b"
server_key_version: "encryptionkey@0"
I20260808 14:38:30.977470 4924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "9fab53c5aa1143dfb439a1b436df1185"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "825b1e25ad37192299ac2aeb17cc8a93"
server_key_iv: "c5f6de88b283e96deb4ff564cdb0001b"
server_key_version: "encryptionkey@0"
I20260808 14:38:30.978830 4924 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:38:30.979554 4944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:30.979737 4924 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:38:30.979838 4924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "9fab53c5aa1143dfb439a1b436df1185"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "825b1e25ad37192299ac2aeb17cc8a93"
server_key_iv: "c5f6de88b283e96deb4ff564cdb0001b"
server_key_version: "encryptionkey@0"
I20260808 14:38:30.979923 4924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:30.992105 4924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:30.994069 4924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:30.994235 4924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:30.994457 4924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:30.994786 4924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:30.994845 4924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:30.994881 4924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:30.994910 4924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:31.000488 4924 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:35025
I20260808 14:38:31.000602 5063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:35025 every 8 connection(s)
I20260808 14:38:31.000916 4924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:38:31.004364 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 4924
I20260808 14:38:31.004490 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:38:31.004729 20804 external_mini_cluster.cc:1428] Setting key a871340f871d3308b38600c13de6a0b9
Aug 08 14:38:31 dist-test-slave-8n49 krb5kdc[4810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199910, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:31.011724 5066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.001767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:57097)
0808 14:38:31.001928 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:31.001965 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:31.002440 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:31.002708 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:31.002711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:31.003288 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:31.003477 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.003482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.004218 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.004219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.005470 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.005473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.005885 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.005886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.006031 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.006542 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:31.006553 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:31.008397 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:31.010370 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:31.010377 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:31.010379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:31.010595 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:31.010820 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:31.010820 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:31.010821 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:31.010917 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:31.011231 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:31.011236 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:31.011353 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 14:38:31.011434 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:38:31.011558 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":91,"threads_started":1}
I20260808 14:38:31.011745 4901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.001821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:57097 (local address 127.20.81.62:34269)
0808 14:38:31.001908 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.001911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.002046 (+ 135us) server_negotiation.cc:407] Connection header received
0808 14:38:31.002552 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.002553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.002564 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.002625 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:31.003561 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.004082 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.005578 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.005796 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.005854 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.008502 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:31.008504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:31.008504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:31.008512 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:31.010287 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:31.010674 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:31.010676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:31.010676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:31.010747 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:31.010984 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:31.010985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:31.010985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:31.011156 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:31.011241 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.011488 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.011602 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:38:31.012413 5064 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34269
I20260808 14:38:31.012531 5064 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:31.012763 5064 heartbeater.cc:511] Master 127.20.81.62:34269 requested a full tablet report, sending...
I20260808 14:38:31.013408 4861 ts_manager.cc:194] Registered new tserver with Master: 9fab53c5aa1143dfb439a1b436df1185 (127.20.81.1:35025)
I20260808 14:38:31.014362 4861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:57097
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:38:31.035089 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34269
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:31.116577 5069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:31.116851 5069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:31.116891 5069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:31.118044 5069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:31.118119 5069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:31.118165 5069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:38:31.119673 5069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:31.119957 5069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:31.120198 5069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:31.125209 5078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:31.125217 5074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:31.125217 5076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:31.125418 5069 server_base.cc:1034] running on GCE node
I20260808 14:38:31.125602 5069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:31.125789 5069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:31.126925 5069 hybrid_clock.cc:648] HybridClock initialized: now 1786199911126913 us; error 27 us; skew 500 ppm
Aug 08 14:38:31 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:31.129387 5069 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:38:31.129860 5069 webserver.cc:460] Webserver started at http://127.20.81.2:41453/ using document root <none> and password file <none>
I20260808 14:38:31.130092 5069 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:31.130162 5069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:31.130316 5069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:31.131361 5069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "940e1e3135666a256a960e9ba7e4a81f"
server_key_iv: "785f7ed4c59a0897a8ce6d8401cb2dfb"
server_key_version: "encryptionkey@0"
I20260808 14:38:31.131752 5069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "940e1e3135666a256a960e9ba7e4a81f"
server_key_iv: "785f7ed4c59a0897a8ce6d8401cb2dfb"
server_key_version: "encryptionkey@0"
I20260808 14:38:31.133265 5069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:38:31.133980 5085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:31.134155 5069 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:38:31.134256 5069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "940e1e3135666a256a960e9ba7e4a81f"
server_key_iv: "785f7ed4c59a0897a8ce6d8401cb2dfb"
server_key_version: "encryptionkey@0"
I20260808 14:38:31.134339 5069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:31.160434 5069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:31.162410 5069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:31.162580 5069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:31.162829 5069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:31.163216 5069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:31.163282 5069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:31.163323 5069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:31.163352 5069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:31.169312 5069 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:36439
I20260808 14:38:31.169359 5214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:36439 every 8 connection(s)
I20260808 14:38:31.169688 5069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:38:31.170339 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 5069
I20260808 14:38:31.170446 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:38:31.170691 20804 external_mini_cluster.cc:1428] Setting key be24341b1f4c400f40bc24b18dce8235
Aug 08 14:38:31 dist-test-slave-8n49 krb5kdc[4810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:38:31.180255 4901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.170374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:53281 (local address 127.20.81.62:34269)
0808 14:38:31.170436 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.170438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.170696 (+ 258us) server_negotiation.cc:407] Connection header received
0808 14:38:31.171354 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.171356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.171369 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.171416 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:31.172385 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.173198 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.174675 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.174858 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.174909 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.177378 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:31.177380 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:31.177380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:31.177388 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:31.178826 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:31.179239 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:31.179240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:31.179241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:31.179304 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:31.179569 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:31.179570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:31.179570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:31.179686 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:31.179772 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.180081 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.180165 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:38:31.180429 5217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.170344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:53281)
0808 14:38:31.170537 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:31.170593 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:31.171217 (+ 624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:31.171508 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:31.171513 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:31.172094 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:31.172284 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.172288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.173296 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.173297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.174591 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.174594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.174940 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.174941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.175094 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.175599 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:31.175610 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:31.177276 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:31.178917 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:31.178924 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:31.178927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:31.179156 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:31.179381 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:31.179382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:31.179382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:31.179492 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:31.179761 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:31.179768 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:31.179934 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 14:38:31.180050 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:38:31.180204 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":107,"threads_started":1}
I20260808 14:38:31.180979 5215 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34269
I20260808 14:38:31.181107 5215 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:31.181289 5215 heartbeater.cc:511] Master 127.20.81.62:34269 requested a full tablet report, sending...
I20260808 14:38:31.181674 4861 ts_manager.cc:194] Registered new tserver with Master: d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439)
I20260808 14:38:31.182072 4861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:53281
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:38:31.198854 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34269
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:31.281800 5220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:31.282042 5220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:31.282081 5220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:31.283311 5220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:31.283375 5220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:31.283421 5220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:38:31.284906 5220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:31.285172 5220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:31.285408 5220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:31.290637 5225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:31.290630 5228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:31.290714 5226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:31.290875 5220 server_base.cc:1034] running on GCE node
I20260808 14:38:31.291074 5220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:31.291322 5220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:31.292464 5220 hybrid_clock.cc:648] HybridClock initialized: now 1786199911292441 us; error 36 us; skew 500 ppm
Aug 08 14:38:31 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:31.294968 5220 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:38:31.295352 5220 webserver.cc:460] Webserver started at http://127.20.81.3:39123/ using document root <none> and password file <none>
I20260808 14:38:31.295536 5220 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:31.295576 5220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:31.295662 5220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:31.296720 5220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "6bf1396675cf4449bc556edff25bf75e"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "a00469feef2c4f9dd1585eb20f529123"
server_key_iv: "6a60f1db6ce6fc410ad7ccd0c2125f78"
server_key_version: "encryptionkey@0"
I20260808 14:38:31.297032 5220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "6bf1396675cf4449bc556edff25bf75e"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "a00469feef2c4f9dd1585eb20f529123"
server_key_iv: "6a60f1db6ce6fc410ad7ccd0c2125f78"
server_key_version: "encryptionkey@0"
I20260808 14:38:31.298269 5220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:31.298945 5237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:31.299127 5220 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:38:31.299234 5220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "6bf1396675cf4449bc556edff25bf75e"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "a00469feef2c4f9dd1585eb20f529123"
server_key_iv: "6a60f1db6ce6fc410ad7ccd0c2125f78"
server_key_version: "encryptionkey@0"
I20260808 14:38:31.299309 5220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:31.312150 5220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:31.314178 5220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:31.314349 5220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:31.314610 5220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:31.314937 5220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:31.314993 5220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:31.315028 5220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:31.315076 5220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:31.321017 5220 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:39429
I20260808 14:38:31.321072 5363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:39429 every 8 connection(s)
I20260808 14:38:31.321383 5220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:38:31.323688 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 5220
I20260808 14:38:31.323836 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:38:31.324128 20804 external_mini_cluster.cc:1428] Setting key 8a2e43d4c50665b7fb7274982578bb09
Aug 08 14:38:31 dist-test-slave-8n49 krb5kdc[4810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:31.330911 4901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.322131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:45971 (local address 127.20.81.62:34269)
0808 14:38:31.322201 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.322203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.322415 (+ 212us) server_negotiation.cc:407] Connection header received
0808 14:38:31.322971 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.322972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.322985 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.323071 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:31.324176 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.325000 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.326017 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.326237 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.326302 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.328296 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:31.328298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:31.328298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:31.328308 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:31.329758 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:31.330144 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:31.330145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:31.330145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:31.330195 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:31.330407 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:31.330407 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:31.330408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:31.330504 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:31.330557 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.330789 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.330848 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:38:31.331067 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.322120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:45971)
0808 14:38:31.322295 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:31.322332 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:31.322857 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:31.323143 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:31.323147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:31.323785 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:31.324082 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.324088 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.325111 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.325112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.325945 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.325947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.326314 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.326315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.326415 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.326856 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:31.326864 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:31.328208 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:31.329832 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:31.329838 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:31.329840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:31.330042 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:31.330253 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:31.330254 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:31.330254 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:31.330351 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:31.330559 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:31.330563 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:31.330678 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 14:38:31.330759 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:38:31.330875 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":82,"threads_started":1}
I20260808 14:38:31.331557 5364 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34269
I20260808 14:38:31.331676 5364 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:31.331857 5364 heartbeater.cc:511] Master 127.20.81.62:34269 requested a full tablet report, sending...
I20260808 14:38:31.332242 4861 ts_manager.cc:194] Registered new tserver with Master: 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429)
I20260808 14:38:31.332703 4861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:45971
I20260808 14:38:31.335824 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:38:31.343079 4901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.337221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40176 (local address 127.20.81.62:34269)
0808 14:38:31.337287 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.337289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.337357 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:38:31.337396 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.337397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.337405 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.337450 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:31.337967 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.338449 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.339182 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.339388 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.339473 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.340580 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:31.340582 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:31.340583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:31.340590 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:31.341873 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:31.342233 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:31.342234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:31.342234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:31.342296 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:31.342504 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:31.342505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:31.342505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:31.342662 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:31.342771 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.342899 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.342979 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:38:31.344729 4861 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:38:31.346309 4861 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:38:31.352844 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.348619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39429 (local address 127.0.0.1:48606)
0808 14:38:31.348882 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:31.348921 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:31.349001 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:31.349317 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:31.349318 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:31.349320 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:31.349374 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.349377 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.350717 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.350718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.351786 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.351788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.352478 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.352479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.352589 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.352605 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:38:31.352710 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 14:38:31.352770 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":55,"threads_started":1}
I20260808 14:38:31.352856 5376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.348677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48606 (local address 127.20.81.3:39429)
0808 14:38:31.348844 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.348850 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.349087 (+ 237us) server_negotiation.cc:407] Connection header received
0808 14:38:31.349146 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.349148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.349165 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.349235 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:31.349454 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.350600 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.351882 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.352367 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.352477 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.352541 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.352730 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.352773 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260808 14:38:31.353164 5379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.349018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33728 (local address 127.20.81.2:36439)
0808 14:38:31.349253 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.349257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.349523 (+ 266us) server_negotiation.cc:407] Connection header received
0808 14:38:31.349596 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.349599 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.349620 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.349701 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:31.349823 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.350828 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.351912 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.352632 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.352708 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.352765 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.353021 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.353067 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":96,"threads_started":1}
I20260808 14:38:31.353077 5374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.348578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35025 (local address 127.0.0.1:55518)
0808 14:38:31.348883 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:31.348935 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:31.349001 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:31.349273 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:31.349276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:31.349278 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:31.349344 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.349345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.350435 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.350436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.351740 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.351743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.352806 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.352807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.352874 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.352882 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:38:31.352931 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:38:31.352976 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":36,"thread_start_us":60,"threads_started":1}
I20260808 14:38:31.353314 5377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.348698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55518 (local address 127.20.81.1:35025)
0808 14:38:31.349023 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.349028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.349039 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:38:31.349081 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.349083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.349097 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.349172 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:31.349441 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.350318 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.351841 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.352660 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.352718 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.352766 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.353157 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.353213 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":81,"threads_started":1}
I20260808 14:38:31.353081 5375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.348798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:36439 (local address 127.0.0.1:33728)
0808 14:38:31.349462 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:31.349472 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:31.349526 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:31.349716 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:31.349717 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:31.349719 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:31.349762 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.349765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.350917 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.350918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.351816 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.351820 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.352804 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.352806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.352874 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.352880 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:38:31.352931 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:38:31.352976 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":6,"thread_start_us":41,"threads_started":1}
I20260808 14:38:31.353971 5291 tablet_service.cc:1467] Processing CreateTablet for tablet 8837bccae7744fcbb0e225b52b4cfc9a (DEFAULT_TABLE table=test-table [id=59347db64ae5432b96f041f5e923bdcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:31.354141 5137 tablet_service.cc:1467] Processing CreateTablet for tablet 8837bccae7744fcbb0e225b52b4cfc9a (DEFAULT_TABLE table=test-table [id=59347db64ae5432b96f041f5e923bdcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:31.354141 4994 tablet_service.cc:1467] Processing CreateTablet for tablet 8837bccae7744fcbb0e225b52b4cfc9a (DEFAULT_TABLE table=test-table [id=59347db64ae5432b96f041f5e923bdcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:31.354339 5291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8837bccae7744fcbb0e225b52b4cfc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:31.354486 5137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8837bccae7744fcbb0e225b52b4cfc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:31.354486 4994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8837bccae7744fcbb0e225b52b4cfc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:31.357230 5380 tablet_bootstrap.cc:492] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: Bootstrap starting.
I20260808 14:38:31.357847 5381 tablet_bootstrap.cc:492] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Bootstrap starting.
I20260808 14:38:31.357962 5380 tablet_bootstrap.cc:654] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:31.358140 5382 tablet_bootstrap.cc:492] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: Bootstrap starting.
I20260808 14:38:31.358603 5380 log.cc:824] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:31.358631 5381 tablet_bootstrap.cc:654] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:31.358721 5382 tablet_bootstrap.cc:654] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:31.359253 5381 log.cc:824] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:31.359295 5382 log.cc:824] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:31.359560 5380 tablet_bootstrap.cc:492] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: No bootstrap required, opened a new log
I20260808 14:38:31.359639 5380 ts_tablet_manager.cc:1397] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:38:31.359988 5382 tablet_bootstrap.cc:492] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: No bootstrap required, opened a new log
I20260808 14:38:31.360072 5382 ts_tablet_manager.cc:1397] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:31.361159 5381 tablet_bootstrap.cc:492] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: No bootstrap required, opened a new log
I20260808 14:38:31.361235 5381 ts_tablet_manager.cc:1397] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:38:31.361254 5380 raft_consensus.cc:348] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:31.361465 5380 raft_consensus.cc:374] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:31.361512 5380 raft_consensus.cc:729] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bf1396675cf4449bc556edff25bf75e, State: Initialized, Role: FOLLOWER
I20260808 14:38:31.361627 5380 consensus_queue.cc:260] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:31.361920 5380 ts_tablet_manager.cc:1428] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:31.362057 5364 heartbeater.cc:503] Master 127.20.81.62:34269 was elected leader, sending a full tablet report...
I20260808 14:38:31.362095 5382 raft_consensus.cc:348] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:31.362274 5382 raft_consensus.cc:374] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:31.362309 5382 raft_consensus.cc:729] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e0b91ffb9b49948bcc9ddaf52d2c76, State: Initialized, Role: FOLLOWER
I20260808 14:38:31.362432 5382 consensus_queue.cc:260] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:31.362715 5382 ts_tablet_manager.cc:1428] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:31.362725 5215 heartbeater.cc:503] Master 127.20.81.62:34269 was elected leader, sending a full tablet report...
I20260808 14:38:31.363353 5381 raft_consensus.cc:348] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:31.363535 5381 raft_consensus.cc:374] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:31.363587 5381 raft_consensus.cc:729] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fab53c5aa1143dfb439a1b436df1185, State: Initialized, Role: FOLLOWER
I20260808 14:38:31.363722 5381 consensus_queue.cc:260] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:31.363987 5381 ts_tablet_manager.cc:1428] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:31.364039 5064 heartbeater.cc:503] Master 127.20.81.62:34269 was elected leader, sending a full tablet report...
W20260808 14:38:31.420336 5216 tablet.cc:2369] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:38:31.501705 5065 tablet.cc:2369] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:38:31.571991 5365 tablet.cc:2369] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:38:31.626421 5387 raft_consensus.cc:482] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:38:31.626626 5387 raft_consensus.cc:504] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:31.627024 5387 leader_election.cc:288] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fab53c5aa1143dfb439a1b436df1185 (127.20.81.1:35025), d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439)
I20260808 14:38:31.630365 5377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.627348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:34937 (local address 127.20.81.1:35025)
0808 14:38:31.627431 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.627433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.627444 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:38:31.627483 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.627484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.627513 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.627622 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:31.627805 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.628601 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.629603 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.629985 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.630073 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.630085 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.630242 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.630284 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:38:31.630402 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.627239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35025 (local address 127.20.81.3:34937)
0808 14:38:31.627296 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:31.627309 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:31.627357 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:31.627641 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:31.627642 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:31.627645 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:31.627720 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.627723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.628694 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.628696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.629503 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.629506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.630072 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.630073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.630159 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.630163 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:38:31.630234 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:38:31.630286 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:38:31.630399 5379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.627475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:38881 (local address 127.20.81.2:36439)
0808 14:38:31.627544 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.627547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.627683 (+ 136us) server_negotiation.cc:407] Connection header received
0808 14:38:31.627731 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.627732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.627743 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.627806 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:31.627939 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.628649 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.629632 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.630026 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.630122 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.630133 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.630288 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.630327 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:38:31.630420 5390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.627382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:36439 (local address 127.20.81.3:38881)
0808 14:38:31.627572 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:31.627581 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:31.627671 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:31.627823 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:31.627824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:31.627825 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:31.627879 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.627880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.628728 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.628729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.629527 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:31.629537 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.630126 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.630127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:31.630200 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.630206 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:38:31.630282 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:38:31.630322 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":135,"threads_started":1}
I20260808 14:38:31.630761 5159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8837bccae7744fcbb0e225b52b4cfc9a" candidate_uuid: "6bf1396675cf4449bc556edff25bf75e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" is_pre_election: true
I20260808 14:38:31.630813 5016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8837bccae7744fcbb0e225b52b4cfc9a" candidate_uuid: "6bf1396675cf4449bc556edff25bf75e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fab53c5aa1143dfb439a1b436df1185" is_pre_election: true
I20260808 14:38:31.630955 5159 raft_consensus.cc:2454] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bf1396675cf4449bc556edff25bf75e in term 0.
I20260808 14:38:31.630990 5016 raft_consensus.cc:2454] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bf1396675cf4449bc556edff25bf75e in term 0.
I20260808 14:38:31.631201 5238 leader_election.cc:302] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bf1396675cf4449bc556edff25bf75e, d9e0b91ffb9b49948bcc9ddaf52d2c76; no voters:
I20260808 14:38:31.631369 5387 raft_consensus.cc:2781] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:38:31.631443 5387 raft_consensus.cc:482] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:38:31.631462 5387 raft_consensus.cc:3037] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:31.632205 5387 raft_consensus.cc:504] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:31.632349 5387 leader_election.cc:288] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [CANDIDATE]: Term 1 election: Requested vote from peers 9fab53c5aa1143dfb439a1b436df1185 (127.20.81.1:35025), d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439)
I20260808 14:38:31.632584 5016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8837bccae7744fcbb0e225b52b4cfc9a" candidate_uuid: "6bf1396675cf4449bc556edff25bf75e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fab53c5aa1143dfb439a1b436df1185"
I20260808 14:38:31.632654 5159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8837bccae7744fcbb0e225b52b4cfc9a" candidate_uuid: "6bf1396675cf4449bc556edff25bf75e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76"
I20260808 14:38:31.632689 5016 raft_consensus.cc:3037] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:31.632720 5159 raft_consensus.cc:3037] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:31.633610 5159 raft_consensus.cc:2454] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bf1396675cf4449bc556edff25bf75e in term 1.
I20260808 14:38:31.633618 5016 raft_consensus.cc:2454] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bf1396675cf4449bc556edff25bf75e in term 1.
I20260808 14:38:31.633806 5238 leader_election.cc:302] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bf1396675cf4449bc556edff25bf75e, 9fab53c5aa1143dfb439a1b436df1185; no voters:
I20260808 14:38:31.633919 5387 raft_consensus.cc:2781] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:31.634131 5387 raft_consensus.cc:686] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 1 LEADER]: Becoming Leader. State: Replica: 6bf1396675cf4449bc556edff25bf75e, State: Running, Role: LEADER
I20260808 14:38:31.634243 5387 consensus_queue.cc:237] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:31.635149 4860 catalog_manager.cc:5495] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bf1396675cf4449bc556edff25bf75e (127.20.81.3). New cstate: current_term: 1 leader_uuid: "6bf1396675cf4449bc556edff25bf75e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260808 14:38:31.642131 5376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.639783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48614 (local address 127.20.81.3:39429)
0808 14:38:31.639848 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.639850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.639877 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:38:31.639940 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.639941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.639957 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.640015 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:31.640132 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.640635 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.641337 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:31.641522 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:31.641581 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:31.641722 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:31.641816 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:31.641875 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.641909 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.641933 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:38:31.643815 5159 raft_consensus.cc:1261] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 1 FOLLOWER]: Refusing update from remote peer 6bf1396675cf4449bc556edff25bf75e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:31.643852 5016 raft_consensus.cc:1261] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Refusing update from remote peer 6bf1396675cf4449bc556edff25bf75e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:31.644161 5387 consensus_queue.cc:1035] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:31.644335 5391 consensus_queue.cc:1035] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:31.646620 5395 mvcc.cc:205] Tried to move back new op lower bound from 7316274838090432512 to 7316274838054481920. Current Snapshot: MvccSnapshot[applied={T|T < 7316274838090432512}]
I20260808 14:38:31.646647 5397 mvcc.cc:205] Tried to move back new op lower bound from 7316274838090432512 to 7316274838054481920. Current Snapshot: MvccSnapshot[applied={T|T < 7316274838090432512}]
I20260808 14:38:31.647583 5396 mvcc.cc:205] Tried to move back new op lower bound from 7316274838090432512 to 7316274838054481920. Current Snapshot: MvccSnapshot[applied={T|T < 7316274838090432512 or (T in {7316274838090432512})}]
I20260808 14:38:31.648929 4860 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:31.649034 4860 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:31.649891 4860 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Sending DeleteTablet for 3 replicas of tablet 8837bccae7744fcbb0e225b52b4cfc9a
I20260808 14:38:31.650287 5291 tablet_service.cc:1514] Processing DeleteTablet for tablet 8837bccae7744fcbb0e225b52b4cfc9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:31 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:48606
I20260808 14:38:31.650305 4994 tablet_service.cc:1514] Processing DeleteTablet for tablet 8837bccae7744fcbb0e225b52b4cfc9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:31 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:55518
I20260808 14:38:31.650311 5137 tablet_service.cc:1514] Processing DeleteTablet for tablet 8837bccae7744fcbb0e225b52b4cfc9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:31 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:33728
I20260808 14:38:31.650503 5406 tablet_replica.cc:330] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: stopping tablet replica
I20260808 14:38:31.650609 5406 raft_consensus.cc:2229] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:31.650619 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 4924
I20260808 14:38:31.650748 5406 raft_consensus.cc:2258] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:31.653815 5408 tablet_replica.cc:330] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: stopping tablet replica
I20260808 14:38:31.653942 5408 raft_consensus.cc:2229] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:31.654053 5408 raft_consensus.cc:2258] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:31.654208 5407 tablet_replica.cc:330] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: stopping tablet replica
I20260808 14:38:31.654332 5407 raft_consensus.cc:2229] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:38:31.654460 5407 raft_consensus.cc:2258] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:31.654623 5408 ts_tablet_manager.cc:1905] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:31.655156 5407 ts_tablet_manager.cc:1905] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:31.657094 5407 ts_tablet_manager.cc:1918] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:31.657231 5407 log.cc:1196] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/8837bccae7744fcbb0e225b52b4cfc9a
I20260808 14:38:31.657840 5407 ts_tablet_manager.cc:1939] T 8837bccae7744fcbb0e225b52b4cfc9a P 6bf1396675cf4449bc556edff25bf75e: Deleting consensus metadata
I20260808 14:38:31.658555 4845 catalog_manager.cc:4841] TS 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429): tablet 8837bccae7744fcbb0e225b52b4cfc9a (table test-table [id=59347db64ae5432b96f041f5e923bdcf]) successfully deleted
I20260808 14:38:31.660512 5408 ts_tablet_manager.cc:1918] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:31.660643 5408 log.cc:1196] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/8837bccae7744fcbb0e225b52b4cfc9a
I20260808 14:38:31.660915 5408 ts_tablet_manager.cc:1939] T 8837bccae7744fcbb0e225b52b4cfc9a P d9e0b91ffb9b49948bcc9ddaf52d2c76: Deleting consensus metadata
I20260808 14:38:31.661368 4843 catalog_manager.cc:4841] TS d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439): tablet 8837bccae7744fcbb0e225b52b4cfc9a (table test-table [id=59347db64ae5432b96f041f5e923bdcf]) successfully deleted
W20260808 14:38:31.667194 4843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:35025 (error 108)
I20260808 14:38:31.667444 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 5069
I20260808 14:38:31.668843 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.667640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35025 (local address 127.0.0.1:55524)
0808 14:38:31.668749 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:31.668798 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1082}
W20260808 14:38:31.670208 4843 catalog_manager.cc:4584] TS 9fab53c5aa1143dfb439a1b436df1185 (127.20.81.1:35025): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8837bccae7744fcbb0e225b52b4cfc9a: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35025: connect: Connection refused (error 111)
I20260808 14:38:31.673756 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 5220
I20260808 14:38:31.680006 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 4824
I20260808 14:38:51.687259 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34269
--webserver_interface=127.20.81.62
--webserver_port=43821
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:34269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:51.773586 5410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:51.773835 5410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:51.773873 5410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:51.775043 5410 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:38:51.775110 5410 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:38:51.775133 5410 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:38:51.775153 5410 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:51.775184 5410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:51.775211 5410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:51.775238 5410 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:51.775269 5410 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:51.776786 5410 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:34269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=43821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:51.777195 5410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:51.777518 5410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:51.787380 5416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:51.787384 5417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:51.787381 5419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:51.787410 5410 server_base.cc:1034] running on GCE node
I20260808 14:38:51.787921 5410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:51.788261 5410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:51.789431 5410 hybrid_clock.cc:648] HybridClock initialized: now 1786199931789419 us; error 45 us; skew 500 ppm
Aug 08 14:38:51 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199931, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:51.792001 5410 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:38:51.792514 5410 webserver.cc:460] Webserver started at http://127.20.81.62:43821/ using document root <none> and password file <none>
I20260808 14:38:51.792790 5410 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:51.792883 5410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:51.794314 5410 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:51.795145 5426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:51.795327 5410 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:38:51.795439 5410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "8c4bf6da0dc1469681a3640a73b7b5a6"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "3cd65683cfd407c4dc779c9731824ceb"
server_key_iv: "57a0151599e44b045d384776ee169314"
server_key_version: "encryptionkey@0"
I20260808 14:38:51.795898 5410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:51.805161 5410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:51.807137 5410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:51.807305 5410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:51.811669 5410 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:34269
I20260808 14:38:51.811700 5489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:34269 every 8 connection(s)
I20260808 14:38:51.812120 5410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:51.813122 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 5410
I20260808 14:38:51.813469 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:35025
--local_ip_for_outbound_sockets=127.20.81.1
--tserver_master_addrs=127.20.81.62:34269
--webserver_port=32775
--webserver_interface=127.20.81.1
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:51.814262 5490 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:38:51.815390 5490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Bootstrap starting.
I20260808 14:38:51.824317 5490 log.cc:824] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:51.826293 5490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:38:51.826627 5490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Bootstrap complete.
I20260808 14:38:51.829169 5490 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:38:51.829423 5490 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c4bf6da0dc1469681a3640a73b7b5a6, State: Initialized, Role: FOLLOWER
I20260808 14:38:51.829632 5490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:38:51.829731 5490 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:51.829792 5490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:51.829842 5490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:38:51.830863 5490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:38:51.830986 5490 leader_election.cc:302] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c4bf6da0dc1469681a3640a73b7b5a6; no voters:
I20260808 14:38:51.831208 5490 leader_election.cc:288] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:38:51.831244 5495 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:38:51.831360 5495 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 2 LEADER]: Becoming Leader. State: Replica: 8c4bf6da0dc1469681a3640a73b7b5a6, State: Running, Role: LEADER
I20260808 14:38:51.831493 5490 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:51.831514 5495 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:38:51.831933 5496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } } }
I20260808 14:38:51.832026 5496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:51.832275 5497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c4bf6da0dc1469681a3640a73b7b5a6. Latest consensus state: current_term: 2 leader_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } } }
I20260808 14:38:51.832365 5497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:51.832491 5503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:51.833434 5503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:51.833609 5503 catalog_manager.cc:1259] Loaded cluster ID: 196768c129fc482795b2839ced083d9d
I20260808 14:38:51.833837 5503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:51.834666 5503 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:51.834860 5503 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Loaded TSK: 0
I20260808 14:38:51.842772 5503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Generated new TSK 1
I20260808 14:38:51.842897 5503 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:38:51.911330 5492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:51.911569 5492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:51.911609 5492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:51.912863 5492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:51.912926 5492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:51.912983 5492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:38:51.914511 5492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:35025
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=32775
--tserver_master_addrs=127.20.81.62:34269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:51.914776 5492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:51.915022 5492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:51.919999 5525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:51.920167 5492 server_base.cc:1034] running on GCE node
W20260808 14:38:51.920359 5523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:51.920032 5522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:51.920744 5492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:51.921036 5492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:51.922227 5492 hybrid_clock.cc:648] HybridClock initialized: now 1786199931922215 us; error 32 us; skew 500 ppm
Aug 08 14:38:51 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199931, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:51.925280 5492 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:38:51.925776 5492 webserver.cc:460] Webserver started at http://127.20.81.1:32775/ using document root <none> and password file <none>
I20260808 14:38:51.926011 5492 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:51.926096 5492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:51.927541 5492 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:51.928287 5532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:51.928479 5492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:51.928613 5492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "9fab53c5aa1143dfb439a1b436df1185"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "825b1e25ad37192299ac2aeb17cc8a93"
server_key_iv: "c5f6de88b283e96deb4ff564cdb0001b"
server_key_version: "encryptionkey@0"
I20260808 14:38:51.928962 5492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:51.939589 5492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:51.941969 5492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:51.942134 5492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:51.942389 5492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:51.942857 5540 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:38:51.944890 5492 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:38:51.944957 5492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:38:51.945024 5492 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:38:51.945654 5492 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:38:51.945710 5492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:51.945791 5540 tablet_bootstrap.cc:492] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Bootstrap starting.
I20260808 14:38:51.953019 5492 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:35025
I20260808 14:38:51.953397 5492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:38:51.957175 5540 log.cc:824] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:51.957221 5657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:35025 every 8 connection(s)
I20260808 14:38:51.959645 5540 tablet_bootstrap.cc:492] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:38:51.960012 5540 tablet_bootstrap.cc:492] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Bootstrap complete.
I20260808 14:38:51.960471 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 5492
I20260808 14:38:51.960880 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:36439
--local_ip_for_outbound_sockets=127.20.81.2
--tserver_master_addrs=127.20.81.62:34269
--webserver_port=41453
--webserver_interface=127.20.81.2
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:51.961298 5540 ts_tablet_manager.cc:1397] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.010s
I20260808 14:38:51.963279 5540 raft_consensus.cc:348] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:51.963723 5540 raft_consensus.cc:729] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fab53c5aa1143dfb439a1b436df1185, State: Initialized, Role: FOLLOWER
I20260808 14:38:51.963935 5540 consensus_queue.cc:260] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } }
I20260808 14:38:51.964260 5540 ts_tablet_manager.cc:1428] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
Aug 08 14:38:51 dist-test-slave-8n49 krb5kdc[4810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199931, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:51.968871 5660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:51.954176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:45011)
0808 14:38:51.954386 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:51.954434 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:51.954892 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:51.957309 (+ 2417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:51.957314 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:51.957685 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:51.957936 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:51.957945 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:51.959743 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:51.959745 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:51.961226 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:51.961230 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:51.962234 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:51.962235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:51.962392 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:51.963065 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:51.963077 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:51.964999 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:51.967083 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:51.967099 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:51.967101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:51.967326 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:51.967644 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:51.967644 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:51.967647 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:51.967757 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:51.968183 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:51.968191 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:51.968324 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 14:38:51.968437 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 14:38:51.968658 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":122,"threads_started":1}
I20260808 14:38:51.968883 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:51.954284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:45011 (local address 127.20.81.62:34269)
0808 14:38:51.956735 (+ 2451us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:51.956744 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:51.956779 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:38:51.956901 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:51.956907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:51.956954 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:51.957154 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:51.958097 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:51.959589 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:51.961339 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:51.961990 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:51.962117 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:51.965153 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:51.965157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:51.965158 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:51.965170 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:51.966933 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:51.967424 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:51.967428 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:51.967429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:51.967560 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:51.967836 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:51.967837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:51.967837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:51.968098 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:51.968192 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:51.968498 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 14:38:51.968674 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2394,"thread_start_us":87,"threads_started":1}
I20260808 14:38:51.970057 5658 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34269
I20260808 14:38:51.970181 5658 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:51.970377 5658 heartbeater.cc:511] Master 127.20.81.62:34269 requested a full tablet report, sending...
I20260808 14:38:51.971181 5448 ts_manager.cc:194] Registered new tserver with Master: 9fab53c5aa1143dfb439a1b436df1185 (127.20.81.1:35025)
I20260808 14:38:51.972429 5448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:45011
I20260808 14:38:51.973385 5658 heartbeater.cc:503] Master 127.20.81.62:34269 was elected leader, sending a full tablet report...
I20260808 14:38:51.980357 5665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:51.971871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35025 (local address 127.0.0.1:45734)
0808 14:38:51.976701 (+ 4830us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:51.976738 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:51.976834 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:51.977034 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:51.977037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:51.977039 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:51.977583 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:51.977586 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:51.978489 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:51.978490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:51.979311 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:51.979313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:51.979996 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:51.979997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:51.980094 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:51.980110 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:38:51.980214 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 14:38:51.980277 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4787,"thread_start_us":141,"threads_started":1}
I20260808 14:38:51.980358 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:51.972197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45734 (local address 127.20.81.1:35025)
0808 14:38:51.972386 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:51.972391 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:51.976815 (+ 4424us) server_negotiation.cc:407] Connection header received
0808 14:38:51.976916 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:51.976919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:51.976935 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:51.977030 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:51.977675 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:51.978383 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:51.979416 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:51.979904 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:51.979995 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:51.980065 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:51.980235 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 14:38:51.980277 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":101,"threads_started":1}
I20260808 14:38:51.981139 5586 tablet_service.cc:1514] Processing DeleteTablet for tablet 8837bccae7744fcbb0e225b52b4cfc9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:31 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:45734
I20260808 14:38:51.981696 5667 tablet_replica.cc:330] stopping tablet replica
I20260808 14:38:51.981829 5667 raft_consensus.cc:2229] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:51.981914 5667 raft_consensus.cc:2258] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:51.982290 5667 ts_tablet_manager.cc:1905] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:51.984711 5667 ts_tablet_manager.cc:1918] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:51.984803 5667 log.cc:1196] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal/wals/8837bccae7744fcbb0e225b52b4cfc9a
I20260808 14:38:51.985060 5667 ts_tablet_manager.cc:1939] T 8837bccae7744fcbb0e225b52b4cfc9a P 9fab53c5aa1143dfb439a1b436df1185: Deleting consensus metadata
I20260808 14:38:51.985617 5427 catalog_manager.cc:4841] TS 9fab53c5aa1143dfb439a1b436df1185 (127.20.81.1:35025): tablet 8837bccae7744fcbb0e225b52b4cfc9a (table test-table [id=59347db64ae5432b96f041f5e923bdcf]) successfully deleted
W20260808 14:38:52.056782 5663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:52.057006 5663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:52.057032 5663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:52.058146 5663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:52.058184 5663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:52.058212 5663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:38:52.059614 5663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:36439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=41453
--tserver_master_addrs=127.20.81.62:34269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:52.059808 5663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:52.060002 5663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:52.065193 5675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:52.065229 5674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:52.065210 5677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:52.065459 5663 server_base.cc:1034] running on GCE node
I20260808 14:38:52.065721 5663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:52.065975 5663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:52.067142 5663 hybrid_clock.cc:648] HybridClock initialized: now 1786199932067121 us; error 41 us; skew 500 ppm
Aug 08 14:38:52 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199932, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:52.069870 5663 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:38:52.070355 5663 webserver.cc:460] Webserver started at http://127.20.81.2:41453/ using document root <none> and password file <none>
I20260808 14:38:52.070593 5663 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:52.070677 5663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:52.072034 5663 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:38:52.072716 5684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:52.072893 5663 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:52.072993 5663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "940e1e3135666a256a960e9ba7e4a81f"
server_key_iv: "785f7ed4c59a0897a8ce6d8401cb2dfb"
server_key_version: "encryptionkey@0"
I20260808 14:38:52.073367 5663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:52.088147 5663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:52.090512 5663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:52.090682 5663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:52.090934 5663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:52.091244 5663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:52.091300 5663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:52.091346 5663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:52.091370 5663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:52.097777 5663 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:36439
I20260808 14:38:52.097858 5806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:36439 every 8 connection(s)
I20260808 14:38:52.098270 5663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:38:52.099241 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 5663
I20260808 14:38:52.099525 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:39429
--local_ip_for_outbound_sockets=127.20.81.3
--tserver_master_addrs=127.20.81.62:34269
--webserver_port=39123
--webserver_interface=127.20.81.3
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:38:52 dist-test-slave-8n49 krb5kdc[4810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199932, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:52.109004 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.098982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:57523 (local address 127.20.81.62:34269)
0808 14:38:52.099086 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.099089 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.099341 (+ 252us) server_negotiation.cc:407] Connection header received
0808 14:38:52.099986 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.099987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.100003 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.100063 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:52.101225 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.101732 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.103266 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.103457 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.103511 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.106031 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:52.106032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:52.106033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:52.106040 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:52.107507 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:52.107934 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:52.107936 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:52.107937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:52.107998 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:52.108268 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:52.108269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:52.108269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:52.108394 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:52.108473 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:52.108805 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 14:38:52.108902 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:38:52.109259 5810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.098970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:57523)
0808 14:38:52.099225 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:52.099255 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:52.099871 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:52.100138 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:52.100142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:52.100794 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:52.101113 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.101120 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.101838 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.101840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.103175 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.103179 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.103550 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.103551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.103710 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.104269 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:52.104280 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:52.105929 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:52.107614 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:52.107622 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:52.107624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:52.107852 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:52.108078 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:52.108079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:52.108079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:52.108193 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:52.108465 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:52.108472 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:52.108670 (+ 198us) client_negotiation.cc:769] Sending connection context
0808 14:38:52.108783 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 14:38:52.108954 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":105,"threads_started":1}
I20260808 14:38:52.109831 5808 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34269
I20260808 14:38:52.109948 5808 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:52.110137 5808 heartbeater.cc:511] Master 127.20.81.62:34269 requested a full tablet report, sending...
I20260808 14:38:52.110596 5448 ts_manager.cc:194] Registered new tserver with Master: d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439)
I20260808 14:38:52.110993 5448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:57523
W20260808 14:38:52.184373 5811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:52.184646 5811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:52.184685 5811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:52.185822 5811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:52.185894 5811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:52.185949 5811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:38:52.187415 5811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:39429
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=39123
--tserver_master_addrs=127.20.81.62:34269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:38:52.187690 5811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:52.187937 5811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:52.193011 5821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:52.192998 5819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:52.192975 5817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:52.193281 5811 server_base.cc:1034] running on GCE node
I20260808 14:38:52.193466 5811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:52.193662 5811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:52.194824 5811 hybrid_clock.cc:648] HybridClock initialized: now 1786199932194809 us; error 31 us; skew 500 ppm
Aug 08 14:38:52 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199932, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:52.197408 5811 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:38:52.197886 5811 webserver.cc:460] Webserver started at http://127.20.81.3:39123/ using document root <none> and password file <none>
I20260808 14:38:52.198117 5811 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:52.198205 5811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:52.199697 5811 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:38:52.200291 5830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:52.200485 5811 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:38:52.200618 5811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "6bf1396675cf4449bc556edff25bf75e"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "a00469feef2c4f9dd1585eb20f529123"
server_key_iv: "6a60f1db6ce6fc410ad7ccd0c2125f78"
server_key_version: "encryptionkey@0"
I20260808 14:38:52.200974 5811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:52.219300 5811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:52.221514 5811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:52.221671 5811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:52.221953 5811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:52.222301 5811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:52.222335 5811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:52.222359 5811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:52.222407 5811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:52.228350 5811 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:39429
I20260808 14:38:52.228404 5953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:39429 every 8 connection(s)
I20260808 14:38:52.228758 5811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:38:52 dist-test-slave-8n49 krb5kdc[4810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199932, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:38:52.235806 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 5811
I20260808 14:38:52.239281 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.229492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:34809 (local address 127.20.81.62:34269)
0808 14:38:52.229566 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.229568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.229780 (+ 212us) server_negotiation.cc:407] Connection header received
0808 14:38:52.230334 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.230336 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.230350 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.230402 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:52.231439 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.231986 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.233178 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.233400 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.233487 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.235793 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:52.235795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:52.235796 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:52.235805 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:52.237646 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:52.238176 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:52.238178 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:52.238178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:52.238238 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:52.238551 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:52.238552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:52.238553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:52.238692 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:52.238769 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:52.239085 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 14:38:52.239180 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:38:52.239378 5956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.229473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:34809)
0808 14:38:52.229662 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:52.229698 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:52.230217 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:52.230474 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:52.230478 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:52.231133 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:52.231338 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.231344 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.232088 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.232089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.233082 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.233085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.233496 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.233497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.233628 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.234117 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:52.234126 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:52.235614 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:52.237731 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:52.237740 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:52.237743 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:52.238070 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:52.238319 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:52.238320 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:52.238320 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:52.238456 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:52.238796 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:52.238802 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:52.238935 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 14:38:52.239036 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:38:52.239172 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":106,"threads_started":1}
I20260808 14:38:52.239856 5954 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34269
I20260808 14:38:52.239979 5954 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:52.240190 5954 heartbeater.cc:511] Master 127.20.81.62:34269 requested a full tablet report, sending...
I20260808 14:38:52.240713 5448 ts_manager.cc:194] Registered new tserver with Master: 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429)
I20260808 14:38:52.241091 5448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:34809
I20260808 14:38:52.243949 5958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.236268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36470 (local address 127.20.81.62:34269)
0808 14:38:52.236680 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.236682 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.236689 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:38:52.236713 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.236714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.236726 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.236791 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:52.237714 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.238465 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.239544 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.239839 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.239907 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.241384 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:52.241386 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:52.241386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:52.241394 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:52.242862 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:52.243265 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:52.243267 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:52.243267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:52.243326 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:52.243510 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:52.243510 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:52.243511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:52.243608 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:52.243725 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:52.243752 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 14:38:52.243819 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":86,"threads_started":1}
I20260808 14:38:52.244848 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:38:52.247661 5958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.245260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36476 (local address 127.20.81.62:34269)
0808 14:38:52.245317 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.245319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.245448 (+ 129us) server_negotiation.cc:407] Connection header received
0808 14:38:52.245497 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.245498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.245528 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.245596 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:52.245697 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.246150 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.246946 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.247138 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.247197 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.247411 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:52.247467 (+ 56us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 14:38:52.247617 (+ 150us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36476: token expired
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 14:38:52.247737 5958 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36476: token expired
W20260808 14:38:52.248678 5372 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.20.81.62:34269)
I20260808 14:38:52.255002 5958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.249093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36484 (local address 127.20.81.62:34269)
0808 14:38:52.249171 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.249173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.249180 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:38:52.249199 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.249200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.249209 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.249275 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:52.249777 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.250231 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.250926 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.251136 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.251212 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.252410 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:52.252412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:52.252412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:52.252419 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:52.253823 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:52.254191 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:52.254193 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:52.254193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:52.254251 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:52.254465 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:52.254466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:52.254466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:52.254614 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:52.254724 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:52.254824 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 14:38:52.254902 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:38:52.256328 5448 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:38:52.258060 5448 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:38:52.260528 5586 tablet_service.cc:1467] Processing CreateTablet for tablet d68ffee8b58f4064856fe73ebd52197c (DEFAULT_TABLE table=test-table [id=91b72fb17197423faec595b03fb76706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:52.260771 5586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d68ffee8b58f4064856fe73ebd52197c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:52.262288 5540 tablet_bootstrap.cc:492] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Bootstrap starting.
I20260808 14:38:52.262624 5540 tablet_bootstrap.cc:654] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:52.263247 5540 tablet_bootstrap.cc:492] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: No bootstrap required, opened a new log
I20260808 14:38:52.263316 5540 ts_tablet_manager.cc:1397] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:38:52.263434 5540 raft_consensus.cc:348] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:38:52.263532 5540 raft_consensus.cc:374] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:52.263586 5540 raft_consensus.cc:729] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fab53c5aa1143dfb439a1b436df1185, State: Initialized, Role: FOLLOWER
I20260808 14:38:52.263633 5540 consensus_queue.cc:260] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:38:52.263732 5540 ts_tablet_manager.cc:1428] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:52.264231 5665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.259986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39429 (local address 127.0.0.1:36002)
0808 14:38:52.260110 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:52.260123 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:52.260172 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:52.260488 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:52.260490 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:52.260491 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:52.260541 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.260542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.261797 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.261798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.262855 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.262857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.263903 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.263904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.263983 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.263988 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:38:52.264044 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:38:52.264120 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":5}
I20260808 14:38:52.264308 5960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.259987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:36439 (local address 127.0.0.1:50978)
0808 14:38:52.260399 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:52.260408 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:52.260482 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:52.260700 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:52.260701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:52.260702 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:52.260755 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.260757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.261681 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.261682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.262951 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.262953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.263973 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.263974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.264048 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.264053 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:38:52.264113 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:38:52.264156 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":25,"thread_start_us":144,"threads_started":1}
I20260808 14:38:52.264533 5962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.260110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50978 (local address 127.20.81.2:36439)
0808 14:38:52.260316 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.260320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.260540 (+ 220us) server_negotiation.cc:407] Connection header received
0808 14:38:52.260605 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.260607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.260625 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.260705 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:52.260855 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.261580 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.263043 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.263783 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.263859 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.263924 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:52.264153 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 14:38:52.264284 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":88,"threads_started":1}
I20260808 14:38:52.264622 5961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.260087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36002 (local address 127.20.81.3:39429)
0808 14:38:52.260290 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.260294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.260303 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:38:52.260343 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.260345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.260362 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.260476 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:52.260647 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.261708 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.263084 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.263783 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.263893 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.263945 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:52.264463 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 14:38:52.264509 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":114,"threads_started":1}
I20260808 14:38:52.265349 5881 tablet_service.cc:1467] Processing CreateTablet for tablet d68ffee8b58f4064856fe73ebd52197c (DEFAULT_TABLE table=test-table [id=91b72fb17197423faec595b03fb76706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:52.265401 5735 tablet_service.cc:1467] Processing CreateTablet for tablet d68ffee8b58f4064856fe73ebd52197c (DEFAULT_TABLE table=test-table [id=91b72fb17197423faec595b03fb76706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:52.265734 5735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d68ffee8b58f4064856fe73ebd52197c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:52.265734 5881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d68ffee8b58f4064856fe73ebd52197c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:52.269476 5965 tablet_bootstrap.cc:492] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: Bootstrap starting.
I20260808 14:38:52.270248 5965 tablet_bootstrap.cc:654] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:52.270816 5965 log.cc:824] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:52.271148 5964 tablet_bootstrap.cc:492] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: Bootstrap starting.
I20260808 14:38:52.271634 5965 tablet_bootstrap.cc:492] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: No bootstrap required, opened a new log
I20260808 14:38:52.271695 5965 ts_tablet_manager.cc:1397] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:52.271708 5964 tablet_bootstrap.cc:654] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:52.272205 5964 log.cc:824] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:52.272974 5964 tablet_bootstrap.cc:492] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: No bootstrap required, opened a new log
I20260808 14:38:52.273056 5964 ts_tablet_manager.cc:1397] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:52.273322 5965 raft_consensus.cc:348] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:38:52.273528 5965 raft_consensus.cc:374] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:52.273617 5965 raft_consensus.cc:729] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bf1396675cf4449bc556edff25bf75e, State: Initialized, Role: FOLLOWER
I20260808 14:38:52.273778 5965 consensus_queue.cc:260] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:38:52.274114 5965 ts_tablet_manager.cc:1428] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:38:52.274138 5954 heartbeater.cc:503] Master 127.20.81.62:34269 was elected leader, sending a full tablet report...
I20260808 14:38:52.275043 5964 raft_consensus.cc:348] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:38:52.275236 5964 raft_consensus.cc:374] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:52.275279 5964 raft_consensus.cc:729] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e0b91ffb9b49948bcc9ddaf52d2c76, State: Initialized, Role: FOLLOWER
I20260808 14:38:52.275394 5964 consensus_queue.cc:260] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:38:52.275662 5964 ts_tablet_manager.cc:1428] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:52.275720 5808 heartbeater.cc:503] Master 127.20.81.62:34269 was elected leader, sending a full tablet report...
I20260808 14:38:52.276508 5969 raft_consensus.cc:482] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:38:52.276623 5969 raft_consensus.cc:504] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:38:52.276937 5969 leader_election.cc:288] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429), 9fab53c5aa1143dfb439a1b436df1185 (127.20.81.1:35025)
I20260808 14:38:52.279784 5810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.277079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39429 (local address 127.20.81.2:40055)
0808 14:38:52.277122 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:52.277135 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:52.277180 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:52.277414 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:52.277415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:52.277417 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:52.277479 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.277481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.278237 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.278238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.278959 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.278961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.279518 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.279520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.279595 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.279599 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:38:52.279679 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:38:52.279717 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 14:38:52.279783 5961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.277262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:40055 (local address 127.20.81.3:39429)
0808 14:38:52.277301 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.277303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.277310 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:38:52.277338 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.277338 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.277346 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.277409 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:52.277561 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.278160 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.279057 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.279436 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.279517 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.279528 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:52.279690 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 14:38:52.279725 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:38:52.279887 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.277085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35025 (local address 127.20.81.2:53903)
0808 14:38:52.277248 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:52.277257 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:52.277341 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:52.277469 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:52.277470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:52.277482 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:52.277546 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.277547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.278314 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.278315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.279023 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:52.279025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.279594 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.279595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:52.279667 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.279671 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:38:52.279771 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:38:52.279809 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":21,"thread_start_us":94,"threads_started":1}
I20260808 14:38:52.279878 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.277150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:53903 (local address 127.20.81.1:35025)
0808 14:38:52.277195 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.277197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.277326 (+ 129us) server_negotiation.cc:407] Connection header received
0808 14:38:52.277396 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.277398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.277410 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.277465 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:52.277621 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.278232 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.279129 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.279493 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.279589 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.279599 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:52.279780 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 14:38:52.279817 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:38:52.280124 5902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d68ffee8b58f4064856fe73ebd52197c" candidate_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bf1396675cf4449bc556edff25bf75e" is_pre_election: true
I20260808 14:38:52.280267 5902 raft_consensus.cc:2454] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e0b91ffb9b49948bcc9ddaf52d2c76 in term 0.
I20260808 14:38:52.280478 5687 leader_election.cc:302] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bf1396675cf4449bc556edff25bf75e, d9e0b91ffb9b49948bcc9ddaf52d2c76; no voters:
I20260808 14:38:52.280527 5608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d68ffee8b58f4064856fe73ebd52197c" candidate_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fab53c5aa1143dfb439a1b436df1185" is_pre_election: true
I20260808 14:38:52.280648 5969 raft_consensus.cc:2781] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:38:52.280712 5969 raft_consensus.cc:482] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:38:52.280745 5969 raft_consensus.cc:3037] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:52.280730 5608 raft_consensus.cc:2454] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e0b91ffb9b49948bcc9ddaf52d2c76 in term 0.
I20260808 14:38:52.281422 5969 raft_consensus.cc:504] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:38:52.281543 5969 leader_election.cc:288] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [CANDIDATE]: Term 1 election: Requested vote from peers 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429), 9fab53c5aa1143dfb439a1b436df1185 (127.20.81.1:35025)
I20260808 14:38:52.281672 5902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d68ffee8b58f4064856fe73ebd52197c" candidate_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bf1396675cf4449bc556edff25bf75e"
I20260808 14:38:52.281672 5608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d68ffee8b58f4064856fe73ebd52197c" candidate_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fab53c5aa1143dfb439a1b436df1185"
I20260808 14:38:52.281744 5902 raft_consensus.cc:3037] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:52.281744 5608 raft_consensus.cc:3037] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:52.282603 5902 raft_consensus.cc:2454] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e0b91ffb9b49948bcc9ddaf52d2c76 in term 1.
I20260808 14:38:52.282603 5608 raft_consensus.cc:2454] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e0b91ffb9b49948bcc9ddaf52d2c76 in term 1.
I20260808 14:38:52.282771 5687 leader_election.cc:302] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bf1396675cf4449bc556edff25bf75e, d9e0b91ffb9b49948bcc9ddaf52d2c76; no voters:
I20260808 14:38:52.282877 5969 raft_consensus.cc:2781] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:52.283015 5969 raft_consensus.cc:686] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 1 LEADER]: Becoming Leader. State: Replica: d9e0b91ffb9b49948bcc9ddaf52d2c76, State: Running, Role: LEADER
I20260808 14:38:52.283111 5969 consensus_queue.cc:237] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:38:52.283907 5448 catalog_manager.cc:5495] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2). New cstate: current_term: 1 leader_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } health_report { overall_health: UNKNOWN } } }
I20260808 14:38:52.293190 5962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.291063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50982 (local address 127.20.81.2:36439)
0808 14:38:52.291113 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:52.291115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:52.291136 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:38:52.291208 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:52.291208 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:52.291223 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:52.291281 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:52.291392 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.291831 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.292505 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:52.292748 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:52.292799 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:52.292933 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:52.293020 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:52.293078 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:52.293110 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 14:38:52.293124 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:38:52.294917 5608 raft_consensus.cc:1261] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Refusing update from remote peer d9e0b91ffb9b49948bcc9ddaf52d2c76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:52.294917 5902 raft_consensus.cc:1261] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [term 1 FOLLOWER]: Refusing update from remote peer d9e0b91ffb9b49948bcc9ddaf52d2c76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:52.295325 5971 consensus_queue.cc:1035] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:52.295500 5969 consensus_queue.cc:1035] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:52.298265 5975 mvcc.cc:205] Tried to move back new op lower bound from 7316274922677149696 to 7316274922632470528. Current Snapshot: MvccSnapshot[applied={T|T < 7316274922677149696}]
I20260808 14:38:52.298403 5978 mvcc.cc:205] Tried to move back new op lower bound from 7316274922677149696 to 7316274922632470528. Current Snapshot: MvccSnapshot[applied={T|T < 7316274922677149696}]
I20260808 14:38:52.299651 5447 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:52.299744 5447 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:52.300522 5447 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Sending DeleteTablet for 3 replicas of tablet d68ffee8b58f4064856fe73ebd52197c
I20260808 14:38:52.300880 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 5492
I20260808 14:38:52.300884 5881 tablet_service.cc:1514] Processing DeleteTablet for tablet d68ffee8b58f4064856fe73ebd52197c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:52 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:36002
I20260808 14:38:52.301851 5735 tablet_service.cc:1514] Processing DeleteTablet for tablet d68ffee8b58f4064856fe73ebd52197c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:52 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:50978
I20260808 14:38:52.302327 5986 tablet_replica.cc:330] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: stopping tablet replica
I20260808 14:38:52.302439 5986 raft_consensus.cc:2229] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:38:52.302563 5986 raft_consensus.cc:2258] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:52.304409 5986 ts_tablet_manager.cc:1905] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:52.306159 5985 tablet_replica.cc:330] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: stopping tablet replica
I20260808 14:38:52.306325 5985 raft_consensus.cc:2229] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:52.306526 5985 raft_consensus.cc:2258] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:52.306725 5986 ts_tablet_manager.cc:1918] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:52.306821 5986 log.cc:1196] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/d68ffee8b58f4064856fe73ebd52197c
I20260808 14:38:52.307088 5986 ts_tablet_manager.cc:1939] T d68ffee8b58f4064856fe73ebd52197c P d9e0b91ffb9b49948bcc9ddaf52d2c76: Deleting consensus metadata
I20260808 14:38:52.307513 5427 catalog_manager.cc:4841] TS d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439): tablet d68ffee8b58f4064856fe73ebd52197c (table test-table [id=91b72fb17197423faec595b03fb76706]) successfully deleted
I20260808 14:38:52.309041 5985 ts_tablet_manager.cc:1905] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:52.310657 5985 ts_tablet_manager.cc:1918] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:52.310750 5985 log.cc:1196] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/d68ffee8b58f4064856fe73ebd52197c
I20260808 14:38:52.311090 5985 ts_tablet_manager.cc:1939] T d68ffee8b58f4064856fe73ebd52197c P 6bf1396675cf4449bc556edff25bf75e: Deleting consensus metadata
I20260808 14:38:52.311571 5433 catalog_manager.cc:4841] TS 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429): tablet d68ffee8b58f4064856fe73ebd52197c (table test-table [id=91b72fb17197423faec595b03fb76706]) successfully deleted
W20260808 14:38:52.313671 5427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:35025 (error 108)
I20260808 14:38:52.314198 5960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:52.314055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35025 (local address 127.0.0.1:45738)
0808 14:38:52.314115 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:52.314158 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:38:52.314235 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 5663
W20260808 14:38:52.317619 5427 catalog_manager.cc:4584] TS 9fab53c5aa1143dfb439a1b436df1185 (127.20.81.1:35025): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d68ffee8b58f4064856fe73ebd52197c: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35025: connect: Connection refused (error 111)
I20260808 14:38:52.322036 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 5811
I20260808 14:38:52.328253 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 5410
I20260808 14:39:12.335762 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34269
--webserver_interface=127.20.81.62
--webserver_port=43821
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:34269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:12.419075 5988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:12.419286 5988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:12.419308 5988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:12.420372 5988 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:39:12.420403 5988 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:39:12.420416 5988 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:39:12.420428 5988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:12.420440 5988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:12.420454 5988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:12.420465 5988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:12.420476 5988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:12.422003 5988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:34269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=43821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:12.422243 5988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:12.422426 5988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:12.427553 5994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:12.427647 5988 server_base.cc:1034] running on GCE node
W20260808 14:39:12.427686 5997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:12.427686 5995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:12.428359 5988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:12.428704 5988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:12.429862 5988 hybrid_clock.cc:648] HybridClock initialized: now 1786199952429851 us; error 40 us; skew 500 ppm
Aug 08 14:39:12 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199952, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:12.432271 5988 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:39:12.432785 5988 webserver.cc:460] Webserver started at http://127.20.81.62:43821/ using document root <none> and password file <none>
I20260808 14:39:12.433024 5988 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:12.433089 5988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:12.434403 5988 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:12.435102 6004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:12.435281 5988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:12.435375 5988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "8c4bf6da0dc1469681a3640a73b7b5a6"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "3cd65683cfd407c4dc779c9731824ceb"
server_key_iv: "57a0151599e44b045d384776ee169314"
server_key_version: "encryptionkey@0"
I20260808 14:39:12.435781 5988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:12.454267 5988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:12.456321 5988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:12.456486 5988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:12.460801 5988 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:34269
I20260808 14:39:12.460845 6061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:34269 every 8 connection(s)
I20260808 14:39:12.461225 5988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:12.461747 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 5988
I20260808 14:39:12.462106 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:35025
--local_ip_for_outbound_sockets=127.20.81.1
--tserver_master_addrs=127.20.81.62:34269
--webserver_port=32775
--webserver_interface=127.20.81.1
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:39:12.463399 6063 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:39:12.464275 6063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Bootstrap starting.
I20260808 14:39:12.473157 6063 log.cc:824] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:12.475459 6063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:39:12.475780 6063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Bootstrap complete.
I20260808 14:39:12.478164 6063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:39:12.478394 6063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c4bf6da0dc1469681a3640a73b7b5a6, State: Initialized, Role: FOLLOWER
I20260808 14:39:12.478565 6063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:39:12.478626 6063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:12.478685 6063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:12.478739 6063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:39:12.479743 6063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:39:12.479852 6063 leader_election.cc:302] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c4bf6da0dc1469681a3640a73b7b5a6; no voters:
I20260808 14:39:12.480067 6063 leader_election.cc:288] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:39:12.480104 6068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:39:12.480288 6068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [term 3 LEADER]: Becoming Leader. State: Replica: 8c4bf6da0dc1469681a3640a73b7b5a6, State: Running, Role: LEADER
I20260808 14:39:12.480372 6063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:12.480432 6068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } }
I20260808 14:39:12.480743 6068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c4bf6da0dc1469681a3640a73b7b5a6. Latest consensus state: current_term: 3 leader_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } } }
I20260808 14:39:12.480995 6068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:12.480909 6071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bf6da0dc1469681a3640a73b7b5a6" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34269 } } }
I20260808 14:39:12.481333 6071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:12.481484 6079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:12.482300 6079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:12.482455 6079 catalog_manager.cc:1259] Loaded cluster ID: 196768c129fc482795b2839ced083d9d
I20260808 14:39:12.482674 6079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:12.483829 6079 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:12.483994 6079 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Loaded TSK: 0
I20260808 14:39:12.484033 6079 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8c4bf6da0dc1469681a3640a73b7b5a6: Loaded TSK: 1
F20260808 14:39:12.484257 6079 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f38d45999ad google::LogMessage::Fail() at ??:0
@ 0x7f38d459c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f38d45994de google::LogMessage::Flush() at ??:0
@ 0x7f38d459aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f38d6d06104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f38d6d03d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f38dc4f31cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f38dc4f348e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f38dc4f3594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f38dc4b9c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f38dc4c3ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f38d64670d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f38d645c954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f38d72c06db start_thread at ??:0
@ 0x7f38d309761f clone at ??:0
W20260808 14:39:12.563279 6065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:12.563472 6065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:12.563494 6065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:12.564682 6065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:12.564719 6065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:12.564746 6065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:39:12.566191 6065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:35025
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=32775
--tserver_master_addrs=127.20.81.62:34269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:12.566423 6065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:12.566663 6065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:12.571684 6112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:12.571700 6114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:12.571699 6111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:12.572204 6065 server_base.cc:1034] running on GCE node
I20260808 14:39:12.572428 6065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:12.572745 6065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:12.573933 6065 hybrid_clock.cc:648] HybridClock initialized: now 1786199952573920 us; error 29 us; skew 500 ppm
Aug 08 14:39:12 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199952, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:12.577033 6065 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:39:12.577610 6065 webserver.cc:460] Webserver started at http://127.20.81.1:32775/ using document root <none> and password file <none>
I20260808 14:39:12.577895 6065 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:12.577960 6065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:12.579725 6065 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:12.580536 6121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:12.580787 6065 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:12.580878 6065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "9fab53c5aa1143dfb439a1b436df1185"
format_stamp: "Formatted at 2026-08-08 14:38:30 on dist-test-slave-8n49"
server_key: "825b1e25ad37192299ac2aeb17cc8a93"
server_key_iv: "c5f6de88b283e96deb4ff564cdb0001b"
server_key_version: "encryptionkey@0"
I20260808 14:39:12.581327 6065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:12.595387 6065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:12.597735 6065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:12.597898 6065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:12.598171 6065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:12.598688 6130 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:39:12.600162 6065 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:39:12.600227 6065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:39:12.600263 6065 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:39:12.601209 6065 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:39:12.601262 6065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:39:12.601320 6130 tablet_bootstrap.cc:492] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Bootstrap starting.
I20260808 14:39:12.608670 6065 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:35025
I20260808 14:39:12.609117 6065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:39:12.611248 6130 log.cc:824] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:12.611543 6251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:35025 every 8 connection(s)
I20260808 14:39:12.613391 6130 tablet_bootstrap.cc:492] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:39:12.613682 6130 tablet_bootstrap.cc:492] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Bootstrap complete.
I20260808 14:39:12.614589 6130 ts_tablet_manager.cc:1397] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260808 14:39:12.615579 6130 raft_consensus.cc:348] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:39:12.615826 6130 raft_consensus.cc:729] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fab53c5aa1143dfb439a1b436df1185, State: Initialized, Role: FOLLOWER
I20260808 14:39:12.616055 6130 consensus_queue.cc:260] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:39:12.616338 6130 ts_tablet_manager.cc:1428] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260808 14:39:12.618176 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 6065
I20260808 14:39:12.618450 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:36439
--local_ip_for_outbound_sockets=127.20.81.2
--tserver_master_addrs=127.20.81.62:34269
--webserver_port=41453
--webserver_interface=127.20.81.2
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:12.688078 6254 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:39:12.609866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:33311)
0808 14:39:12.610108 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:12.610162 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:12.610814 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:12.687871 (+ 77057us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":117,"threads_started":1}
W20260808 14:39:12.688346 6252 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:34269 (0 consecutive failures): Network error: Failed to ping master at 127.20.81.62:34269: Client connection negotiation failed: client connection to 127.20.81.62:34269: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:39:12.688711 6254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:12.688591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:39355)
0808 14:39:12.688639 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:12.688686 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:39:12.689108 6254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:12.689023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:50587)
0808 14:39:12.689066 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:12.689090 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 14:39:12.689244 6252 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:39:12.702087 6259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:12.702265 6259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:12.702287 6259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:12.703502 6259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:12.703539 6259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:12.703585 6259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:39:12.705030 6259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:36439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=41453
--tserver_master_addrs=127.20.81.62:34269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:12.705225 6259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:12.705386 6259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:12.709993 6264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:12.710112 6259 server_base.cc:1034] running on GCE node
W20260808 14:39:12.710001 6265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:12.710006 6267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:12.710373 6259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:12.710618 6259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:12.711772 6259 hybrid_clock.cc:648] HybridClock initialized: now 1786199952711758 us; error 26 us; skew 500 ppm
Aug 08 14:39:12 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199952, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:12.714167 6259 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:39:12.714570 6259 webserver.cc:460] Webserver started at http://127.20.81.2:41453/ using document root <none> and password file <none>
I20260808 14:39:12.714800 6259 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:12.714866 6259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:12.716179 6259 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:39:12.716787 6277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:12.716949 6259 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:12.717036 6259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "940e1e3135666a256a960e9ba7e4a81f"
server_key_iv: "785f7ed4c59a0897a8ce6d8401cb2dfb"
server_key_version: "encryptionkey@0"
I20260808 14:39:12.717360 6259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:12.736995 6259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:12.738878 6259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:12.739033 6259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:12.739266 6259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:12.739571 6259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:12.739621 6259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:12.739661 6259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:12.739691 6259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:12.745527 6259 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:36439
I20260808 14:39:12.745626 6404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:36439 every 8 connection(s)
I20260808 14:39:12.745936 6259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:39:12.746989 6407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:12.746634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:36859)
0808 14:39:12.746787 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:12.746853 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":78,"threads_started":1}
W20260808 14:39:12.747390 6405 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:34269 (0 consecutive failures): Network error: Failed to ping master at 127.20.81.62:34269: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
I20260808 14:39:12.747669 6407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:12.747587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:54937)
0808 14:39:12.747629 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:12.747653 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:39:12.747997 6407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:12.747916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:34821)
0808 14:39:12.747949 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:12.747974 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260808 14:39:12.748114 6405 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:39:12.754312 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 6259
I20260808 14:39:12.754606 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:39429
--local_ip_for_outbound_sockets=127.20.81.3
--tserver_master_addrs=127.20.81.62:34269
--webserver_port=39123
--webserver_interface=127.20.81.3
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:12.837769 6409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:12.837965 6409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:12.837987 6409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:12.839120 6409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:12.839164 6409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:12.839190 6409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:39:12.840664 6409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:39429
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=39123
--tserver_master_addrs=127.20.81.62:34269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:12.840901 6409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:12.841131 6409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:12.846081 6416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:12.846104 6417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:12.846081 6420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:12.846266 6409 server_base.cc:1034] running on GCE node
I20260808 14:39:12.846577 6409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:12.846779 6409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:12.847961 6409 hybrid_clock.cc:648] HybridClock initialized: now 1786199952847954 us; error 39 us; skew 500 ppm
Aug 08 14:39:12 dist-test-slave-8n49 krb5kdc[4810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199952, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:12.850524 6409 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:39:12.850986 6409 webserver.cc:460] Webserver started at http://127.20.81.3:39123/ using document root <none> and password file <none>
I20260808 14:39:12.851213 6409 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:12.851277 6409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:12.852653 6409 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:12.853243 6429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:12.853443 6409 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:39:12.853554 6409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "6bf1396675cf4449bc556edff25bf75e"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-8n49"
server_key: "a00469feef2c4f9dd1585eb20f529123"
server_key_iv: "6a60f1db6ce6fc410ad7ccd0c2125f78"
server_key_version: "encryptionkey@0"
I20260808 14:39:12.853915 6409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:12.866822 6409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:12.868891 6409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:12.869060 6409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:12.869294 6409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:12.869612 6409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:12.869665 6409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:12.869706 6409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:12.869735 6409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:12.875710 6409 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:39429
I20260808 14:39:12.875765 6562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:39429 every 8 connection(s)
I20260808 14:39:12.876101 6409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:39:12.877184 6565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:12.876762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:34285)
0808 14:39:12.876962 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:12.877038 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":78,"threads_started":1}
W20260808 14:39:12.877596 6563 heartbeater.cc:644] Failed to heartbeat to 127.20.81.62:34269 (0 consecutive failures): Network error: Failed to ping master at 127.20.81.62:34269: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
I20260808 14:39:12.877888 6565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:12.877791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:44117)
0808 14:39:12.877839 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:12.877868 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:39:12.878175 6565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:12.878090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:59617)
0808 14:39:12.878131 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:12.878154 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 14:39:12.878326 6563 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:39:12.879981 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 6409
I20260808 14:39:13.689873 6567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:13.689618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:35551)
0808 14:39:13.689780 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:13.689820 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":73,"threads_started":1}
I20260808 14:39:13.748692 6568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:13.748449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:38085)
0808 14:39:13.748605 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:13.748646 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":59,"threads_started":1}
I20260808 14:39:13.878821 6569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:13.878627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:40097)
0808 14:39:13.878743 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:13.878775 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":56,"threads_started":1}
I20260808 14:39:13.923086 6570 raft_consensus.cc:482] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:13.923261 6570 raft_consensus.cc:504] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:39:13.923630 6570 leader_election.cc:288] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439), 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429)
Aug 08 14:39:13 dist-test-slave-8n49 krb5kdc[4810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199952, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.2@KRBTEST.COM
Aug 08 14:39:13 dist-test-slave-8n49 krb5kdc[4810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199952, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.3@KRBTEST.COM
I20260808 14:39:13.936828 6567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:13.923790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:36439 (local address 127.20.81.1:58911)
0808 14:39:13.923850 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:13.923861 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:13.923920 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:13.925080 (+ 1160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:13.925083 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:13.925635 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:13.925926 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:13.925934 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:13.927636 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:13.927638 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:13.929023 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:13.929026 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:13.929897 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:13.929898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:13.930059 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:13.930685 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:13.930697 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:13.932745 (+ 2048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:13.935054 (+ 2309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:13.935062 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:13.935064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:13.935291 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:13.935568 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:13.935569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:13.935569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:13.935713 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:13.936214 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:13.936221 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:13.936338 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 14:39:13.936498 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 14:39:13.936701 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":83}
I20260808 14:39:13.936836 6573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:13.923911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:58911 (local address 127.20.81.2:36439)
0808 14:39:13.924065 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:13.924078 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:13.924116 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:39:13.924777 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:13.924781 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:13.924832 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:13.924994 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:13.926084 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:13.927514 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:13.929120 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:13.929784 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:13.929912 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:13.932885 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:13.932890 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:13.932890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:13.932903 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:13.934955 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:13.935379 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:13.935383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:13.935383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:13.935498 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:13.935788 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:13.935789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:13.935789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:13.936141 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:13.936227 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:13.936542 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 14:39:13.936721 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":90,"threads_started":1}
I20260808 14:39:13.936993 6575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:13.923938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:35623 (local address 127.20.81.3:39429)
0808 14:39:13.924131 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:13.924140 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:13.924169 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:39:13.924764 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:13.924768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:13.924832 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:13.925006 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:13.926084 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:13.927508 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:13.929120 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:13.929784 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:13.929911 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:13.933234 (+ 3323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:13.933238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:13.933239 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:13.933251 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:13.935345 (+ 2094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:13.935719 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:13.935721 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:13.935722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:13.935849 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:13.936043 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:13.936043 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:13.936044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:13.936359 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:13.936515 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:13.936756 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 14:39:13.936886 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":65,"threads_started":1}
I20260808 14:39:13.936843 6572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:13.923812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39429 (local address 127.20.81.1:35623)
0808 14:39:13.923953 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:13.923964 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:13.924034 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:13.925080 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:13.925083 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:13.925635 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:13.925926 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:13.925934 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:13.927647 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:13.927647 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:13.929022 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:13.929026 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:13.929895 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:13.929897 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:13.930059 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:13.930708 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:13.930712 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:13.933123 (+ 2411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:13.935424 (+ 2301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:13.935424 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:13.935425 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:13.935639 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:13.935920 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:13.935920 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:13.935921 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:13.935979 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:13.936539 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:13.936540 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:13.936605 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 14:39:13.936678 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:39:13.936756 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":93,"thread_start_us":72,"threads_started":1}
W20260808 14:39:13.937983 6123 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
W20260808 14:39:13.938073 6126 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
I20260808 14:39:13.938166 6126 leader_election.cc:302] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fab53c5aa1143dfb439a1b436df1185; no voters: 6bf1396675cf4449bc556edff25bf75e, d9e0b91ffb9b49948bcc9ddaf52d2c76
I20260808 14:39:13.938304 6570 raft_consensus.cc:2726] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:39:14.690659 6576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:14.690405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:57951)
0808 14:39:14.690557 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:14.690599 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":73,"threads_started":1}
I20260808 14:39:14.749364 6577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:14.749155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:33339)
0808 14:39:14.749282 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:14.749321 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260808 14:39:14.879628 6578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:14.879368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:58995)
0808 14:39:14.879532 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:14.879574 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":66,"threads_started":1}
I20260808 14:39:15.625561 6580 raft_consensus.cc:482] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:15.625669 6580 raft_consensus.cc:504] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:39:15.625921 6580 leader_election.cc:288] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439), 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429)
W20260808 14:39:15.626396 6126 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
W20260808 14:39:15.626478 6123 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
I20260808 14:39:15.626523 6123 leader_election.cc:302] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fab53c5aa1143dfb439a1b436df1185; no voters: 6bf1396675cf4449bc556edff25bf75e, d9e0b91ffb9b49948bcc9ddaf52d2c76
I20260808 14:39:15.626619 6580 raft_consensus.cc:2726] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:39:15.691371 6581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:15.691120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:53243)
0808 14:39:15.691268 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:15.691305 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":69,"threads_started":1}
I20260808 14:39:15.750118 6582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:15.749869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:53303)
0808 14:39:15.750033 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:15.750069 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":94,"threads_started":1}
I20260808 14:39:15.880355 6583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:15.880137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:59739)
0808 14:39:15.880262 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:15.880298 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260808 14:39:16.692117 6584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:16.691838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:40677)
0808 14:39:16.692018 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:16.692067 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":82,"threads_started":1}
I20260808 14:39:16.750845 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:16.750613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:54307)
0808 14:39:16.750761 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:16.750804 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":66,"threads_started":1}
I20260808 14:39:16.881266 6588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:16.881020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:40495)
0808 14:39:16.881173 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:16.881220 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260808 14:39:17.693006 6589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:17.692751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:52447)
0808 14:39:17.692911 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:17.692955 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260808 14:39:17.751577 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:17.751373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:34917)
0808 14:39:17.751500 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:17.751532 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260808 14:39:17.882004 6591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:17.881781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:56203)
0808 14:39:17.881920 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:17.881955 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260808 14:39:18.693747 6593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:18.693521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:42131)
0808 14:39:18.693657 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:18.693698 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260808 14:39:18.752266 6594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:18.752068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:52813)
0808 14:39:18.752191 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:18.752224 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260808 14:39:18.882654 6595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:18.882437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:47177)
0808 14:39:18.882572 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:18.882610 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260808 14:39:18.948311 6596 raft_consensus.cc:482] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:18.948438 6596 raft_consensus.cc:504] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:39:18.948719 6596 leader_election.cc:288] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439), 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429)
W20260808 14:39:18.949136 6126 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
W20260808 14:39:18.949215 6123 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
I20260808 14:39:18.949297 6123 leader_election.cc:302] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fab53c5aa1143dfb439a1b436df1185; no voters: 6bf1396675cf4449bc556edff25bf75e, d9e0b91ffb9b49948bcc9ddaf52d2c76
I20260808 14:39:18.949388 6596 raft_consensus.cc:2726] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:39:19.694501 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:19.694271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:50377)
0808 14:39:19.694412 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:19.694450 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
I20260808 14:39:19.753033 6598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:19.752801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:47265)
0808 14:39:19.752952 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:19.752990 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260808 14:39:19.883375 6599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:19.883170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:33897)
0808 14:39:19.883292 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:19.883331 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":65,"threads_started":1}
I20260808 14:39:20.695272 6600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:20.695019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:50815)
0808 14:39:20.695183 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:20.695222 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":68,"threads_started":1}
I20260808 14:39:20.753693 6601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:20.753494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:56039)
0808 14:39:20.753617 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:20.753654 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260808 14:39:20.884088 6603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:20.883849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:46729)
0808 14:39:20.884002 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:20.884041 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":67,"threads_started":1}
I20260808 14:39:21.696022 6604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:21.695801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:42387)
0808 14:39:21.695928 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:21.695966 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260808 14:39:21.754343 6605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:21.754123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:41105)
0808 14:39:21.754260 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:21.754297 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260808 14:39:21.884820 6606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:21.884597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:59477)
0808 14:39:21.884732 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:21.884772 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
I20260808 14:39:22.696866 6607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:22.696610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:44421)
0808 14:39:22.696770 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:22.696813 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":78,"threads_started":1}
I20260808 14:39:22.755085 6608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:22.754865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:52545)
0808 14:39:22.754998 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:22.755037 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260808 14:39:22.885596 6609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:22.885340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:42079)
0808 14:39:22.885505 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:22.885545 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":98,"threads_started":1}
I20260808 14:39:22.940840 6610 raft_consensus.cc:482] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:22.940960 6610 raft_consensus.cc:504] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:39:22.941164 6610 leader_election.cc:288] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439), 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429)
W20260808 14:39:22.941617 6126 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
W20260808 14:39:22.941702 6123 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
I20260808 14:39:22.941804 6123 leader_election.cc:302] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fab53c5aa1143dfb439a1b436df1185; no voters: 6bf1396675cf4449bc556edff25bf75e, d9e0b91ffb9b49948bcc9ddaf52d2c76
I20260808 14:39:22.941910 6610 raft_consensus.cc:2726] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:39:23.697636 6611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:23.697375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:59719)
0808 14:39:23.697544 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:23.697585 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":82,"threads_started":1}
I20260808 14:39:23.755878 6612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:23.755613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:45193)
0808 14:39:23.755752 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:23.755803 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
I20260808 14:39:23.886520 6613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:23.886251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:40669)
0808 14:39:23.886416 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:23.886455 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":91,"threads_started":1}
I20260808 14:39:24.698354 6614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:24.698139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:44729)
0808 14:39:24.698269 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:24.698304 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260808 14:39:24.756731 6615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:24.756395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:40977)
0808 14:39:24.756636 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:24.756681 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":93,"threads_started":1}
I20260808 14:39:24.887300 6617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:24.887049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:55231)
0808 14:39:24.887208 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:24.887250 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260808 14:39:25.699158 6618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:25.698902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:36373)
0808 14:39:25.699056 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:25.699105 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
I20260808 14:39:25.757513 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:25.757219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:41565)
0808 14:39:25.757352 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:25.757396 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260808 14:39:25.767048 6622 raft_consensus.cc:482] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:25.767146 6622 raft_consensus.cc:504] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e0b91ffb9b49948bcc9ddaf52d2c76" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36439 } } peers { permanent_uuid: "6bf1396675cf4449bc556edff25bf75e" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39429 } } peers { permanent_uuid: "9fab53c5aa1143dfb439a1b436df1185" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35025 } }
I20260808 14:39:25.767380 6622 leader_election.cc:288] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439), 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429)
W20260808 14:39:25.767819 6123 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9e0b91ffb9b49948bcc9ddaf52d2c76 (127.20.81.2:36439): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
W20260808 14:39:25.767894 6126 leader_election.cc:341] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf1396675cf4449bc556edff25bf75e (127.20.81.3:39429): Not found: Tablet not found: d68ffee8b58f4064856fe73ebd52197c
I20260808 14:39:25.767982 6126 leader_election.cc:302] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fab53c5aa1143dfb439a1b436df1185; no voters: 6bf1396675cf4449bc556edff25bf75e, d9e0b91ffb9b49948bcc9ddaf52d2c76
I20260808 14:39:25.768062 6622 raft_consensus.cc:2726] T d68ffee8b58f4064856fe73ebd52197c P 9fab53c5aa1143dfb439a1b436df1185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:39:25.888161 6623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:25.887888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:33287)
0808 14:39:25.888059 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:25.888110 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
I20260808 14:39:26.699998 6625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:26.699739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:37729)
0808 14:39:26.699888 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:26.699937 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":74,"threads_started":1}
I20260808 14:39:26.758368 6626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:26.758103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:55061)
0808 14:39:26.758259 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:26.758305 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":76,"threads_started":1}
I20260808 14:39:26.888960 6627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:26.888707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:60295)
0808 14:39:26.888868 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:26.888909 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":83,"threads_started":1}
I20260808 14:39:27.700892 6628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:27.700668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.1:38995)
0808 14:39:27.700809 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:27.700842 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":68,"threads_started":1}
I20260808 14:39:27.759235 6629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:27.758990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.2:49141)
0808 14:39:27.759149 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:27.759188 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260808 14:39:27.886456 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 6065
I20260808 14:39:27.889736 6630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:27.889544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34269 (local address 127.20.81.3:58551)
0808 14:39:27.889648 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:27.889690 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.62:34269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":57,"threads_started":1}
I20260808 14:39:27.893867 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 6259
I20260808 14:39:27.899607 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 6409
2026-08-08T14:39:27Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58461 ms)
[----------] 30 tests from SecurityITest (232488 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:27 dist-test-slave-8n49 krb5kdc[6634](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:27 dist-test-slave-8n49 krb5kdc[6634](info): set up 2 sockets
Aug 08 14:39:27 dist-test-slave-8n49 krb5kdc[6634](info): commencing operation
krb5kdc: starting...
W20260808 14:39:28.981650 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:29 dist-test-slave-8n49 krb5kdc[6634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199969, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:39:29.107164 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34767
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:34767
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:29.190425 6648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:29.190667 6648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:29.190706 6648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:29.191847 6648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:29.191921 6648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:29.191951 6648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:29.191972 6648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:29.192003 6648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:29.193549 6648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:34767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:34767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:29.193825 6648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:29.194060 6648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:29.199211 6654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:29.199246 6648 server_base.cc:1034] running on GCE node
W20260808 14:39:29.199398 6656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:29.199390 6653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:29.199775 6648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:29.200074 6648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:29.201236 6648 hybrid_clock.cc:648] HybridClock initialized: now 1786199969201221 us; error 51 us; skew 500 ppm
Aug 08 14:39:29 dist-test-slave-8n49 krb5kdc[6634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199969, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:29.203846 6648 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:39:29.204341 6648 webserver.cc:460] Webserver started at http://127.20.81.62:38461/ using document root <none> and password file <none>
I20260808 14:39:29.204660 6648 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:29.204741 6648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:29.204914 6648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:29.206148 6648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "2f45e7a03f3146919f4a74089f3bf5aa"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "8c847468d7f4db6451d8583025ac2f1f"
server_key_iv: "f0ea976e08ac3e67960419b45a5c3372"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.206557 6648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "2f45e7a03f3146919f4a74089f3bf5aa"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "8c847468d7f4db6451d8583025ac2f1f"
server_key_iv: "f0ea976e08ac3e67960419b45a5c3372"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.208166 6648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:29.209087 6664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.209287 6648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:39:29.209404 6648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "2f45e7a03f3146919f4a74089f3bf5aa"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "8c847468d7f4db6451d8583025ac2f1f"
server_key_iv: "f0ea976e08ac3e67960419b45a5c3372"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.209489 6648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:29.243943 6648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:29.246145 6648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:29.246335 6648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:29.250949 6648 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:34767
I20260808 14:39:29.250988 6721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:34767 every 8 connection(s)
I20260808 14:39:29.251415 6648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:29.252308 6722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:29.253168 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 6648
I20260808 14:39:29.253291 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:29.253523 20804 external_mini_cluster.cc:1428] Setting key a6ae5e42fddef14e7bf2721a0f860535
I20260808 14:39:29.255818 6722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa: Bootstrap starting.
I20260808 14:39:29.256628 6722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:29.256964 6722 log.cc:824] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:29.257718 6722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa: No bootstrap required, opened a new log
I20260808 14:39:29.260119 6722 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f45e7a03f3146919f4a74089f3bf5aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34767 } }
I20260808 14:39:29.260257 6722 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:29.260280 6722 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45e7a03f3146919f4a74089f3bf5aa, State: Initialized, Role: FOLLOWER
I20260808 14:39:29.260424 6722 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f45e7a03f3146919f4a74089f3bf5aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34767 } }
I20260808 14:39:29.260512 6722 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:29.260586 6722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:29.260641 6722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [term 0 FOLLOWER]: Advancing to term 1
Aug 08 14:39:29 dist-test-slave-8n49 krb5kdc[6634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199969, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:29.261217 6722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f45e7a03f3146919f4a74089f3bf5aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34767 } }
I20260808 14:39:29.261322 6722 leader_election.cc:302] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f45e7a03f3146919f4a74089f3bf5aa; no voters:
I20260808 14:39:29.261555 6722 leader_election.cc:288] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:29.261590 6727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:29.261745 6727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [term 1 LEADER]: Becoming Leader. State: Replica: 2f45e7a03f3146919f4a74089f3bf5aa, State: Running, Role: LEADER
I20260808 14:39:29.261839 6722 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:29.261911 6727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f45e7a03f3146919f4a74089f3bf5aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34767 } }
I20260808 14:39:29.262610 6731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f45e7a03f3146919f4a74089f3bf5aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f45e7a03f3146919f4a74089f3bf5aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34767 } } }
I20260808 14:39:29.262759 6731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:29.262601 6727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f45e7a03f3146919f4a74089f3bf5aa. Latest consensus state: current_term: 1 leader_uuid: "2f45e7a03f3146919f4a74089f3bf5aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f45e7a03f3146919f4a74089f3bf5aa" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 34767 } } }
I20260808 14:39:29.263072 6727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa [sys.catalog]: This master's current role is: LEADER
W20260808 14:39:29.263952 6747 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:39:29.264021 6747 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:39:29.264083 6740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:29.264249 6740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:29.265965 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.254160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35368 (local address 127.20.81.62:34767)
0808 14:39:29.254368 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:29.254378 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:29.254414 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:39:29.255009 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:29.255019 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:29.255086 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:29.255242 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:29.255873 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.257299 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.258128 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.258732 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.258854 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.261728 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:29.261733 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:29.261733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:29.261749 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:29.264026 (+ 2277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.264466 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.264469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.264470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.264609 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.264842 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.264843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.264844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.265178 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:29.265331 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:29.265602 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 14:39:29.265711 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":87,"threads_started":1}
I20260808 14:39:29.271230 6740 catalog_manager.cc:1347] Generated new cluster ID: bf6cf109fef04cc2a6f1ce2c69bcdf7a
I20260808 14:39:29.271291 6740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:29.280457 6740 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:29.280997 6740 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:29.283520 6740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa: Generated new TSK 0
I20260808 14:39:29.283684 6740 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:39:29.321556 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34767
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:29.438902 6754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:29.439145 6754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:29.439188 6754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:29.440344 6754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:29.440409 6754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:29.440457 6754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:39:29.442008 6754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:29.442279 6754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:29.442517 6754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:39:29.447696 6754 server_base.cc:1034] running on GCE node
W20260808 14:39:29.447669 6759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:29.447669 6762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:29.447728 6760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:29.448123 6754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:29.448333 6754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:29.449477 6754 hybrid_clock.cc:648] HybridClock initialized: now 1786199969449448 us; error 50 us; skew 500 ppm
Aug 08 14:39:29 dist-test-slave-8n49 krb5kdc[6634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199969, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:29.452078 6754 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:39:29.452664 6754 webserver.cc:460] Webserver started at http://127.20.81.1:33425/ using document root <none> and password file <none>
I20260808 14:39:29.452893 6754 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:29.452940 6754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:29.453096 6754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:29.454167 6754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "bae94fa65714449bb7d68f1a7788191f"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "7690e57eaa73e6838ee24293c7cf6ce5"
server_key_iv: "bd26ab0bb035c3f9fcbbf7136f4316d7"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.454552 6754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "bae94fa65714449bb7d68f1a7788191f"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "7690e57eaa73e6838ee24293c7cf6ce5"
server_key_iv: "bd26ab0bb035c3f9fcbbf7136f4316d7"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.455942 6754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:39:29.456812 6769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.457103 6754 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:39:29.457209 6754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "bae94fa65714449bb7d68f1a7788191f"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "7690e57eaa73e6838ee24293c7cf6ce5"
server_key_iv: "bd26ab0bb035c3f9fcbbf7136f4316d7"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.457283 6754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:29.467629 6754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:29.470038 6754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:29.470201 6754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:29.470438 6754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:29.470764 6754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:29.470821 6754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.470865 6754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:29.470890 6754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.476967 6754 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:35115
I20260808 14:39:29.477016 6899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:35115 every 8 connection(s)
I20260808 14:39:29.477336 6754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:39:29.478588 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 6754
I20260808 14:39:29.478722 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:39:29.478929 20804 external_mini_cluster.cc:1428] Setting key 5cbacf548059cca9a4c868b9ede546cf
Aug 08 14:39:29 dist-test-slave-8n49 krb5kdc[6634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199969, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:29.487915 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.478044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:52687 (local address 127.20.81.62:34767)
0808 14:39:29.478110 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:29.478126 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:29.478322 (+ 196us) server_negotiation.cc:407] Connection header received
0808 14:39:29.478959 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:29.478960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:29.478974 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:29.479035 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:29.480112 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.480686 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.482128 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.482333 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.482387 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.484934 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:29.484935 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:29.484936 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:29.484941 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:29.486365 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.486881 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.486883 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.486883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.486940 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.487246 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.487247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.487247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.487359 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:29.487414 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:29.487773 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 14:39:29.487844 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
I20260808 14:39:29.488176 6903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.478021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34767 (local address 127.20.81.1:52687)
0808 14:39:29.478188 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:29.478236 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:29.478846 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:29.479105 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:29.479109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:29.479819 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:29.480013 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.480019 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.480780 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.480781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.482017 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.482021 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.482409 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.482410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.482551 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.483057 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:29.483065 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:29.484838 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:29.486456 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:29.486464 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:29.486467 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:29.486789 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:29.487020 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:29.487021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:29.487022 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:29.487167 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:29.487433 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:29.487443 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:29.487632 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 14:39:29.487755 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 14:39:29.487919 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260808 14:39:29.488780 6900 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34767
I20260808 14:39:29.488889 6900 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:29.489078 6900 heartbeater.cc:511] Master 127.20.81.62:34767 requested a full tablet report, sending...
I20260808 14:39:29.489617 6682 ts_manager.cc:194] Registered new tserver with Master: bae94fa65714449bb7d68f1a7788191f (127.20.81.1:35115)
I20260808 14:39:29.490262 6682 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:52687
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:39:29.505350 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34767
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:29.587709 6906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:29.587910 6906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:29.587934 6906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:29.589015 6906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:29.589051 6906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:29.589083 6906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:39:29.590524 6906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:29.590704 6906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:29.590871 6906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:29.595850 6917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:29.595860 6913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:29.595914 6906 server_base.cc:1034] running on GCE node
W20260808 14:39:29.595855 6915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:29.596222 6906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:29.596480 6906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:29.597659 6906 hybrid_clock.cc:648] HybridClock initialized: now 1786199969597646 us; error 32 us; skew 500 ppm
Aug 08 14:39:29 dist-test-slave-8n49 krb5kdc[6634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199969, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:29.600175 6906 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:39:29.600730 6906 webserver.cc:460] Webserver started at http://127.20.81.2:38441/ using document root <none> and password file <none>
I20260808 14:39:29.600962 6906 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:29.601030 6906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:29.601166 6906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:29.602250 6906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "49a9efdaa95d4b88b392a76f5f7298fd"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "19acd60ee960d11263c9850e12a4de91"
server_key_iv: "e73fb0845b60e5dccd75df6196576148"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.602628 6906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "49a9efdaa95d4b88b392a76f5f7298fd"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "19acd60ee960d11263c9850e12a4de91"
server_key_iv: "e73fb0845b60e5dccd75df6196576148"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.603987 6906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:29.604789 6925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.605005 6906 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:29.605104 6906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "49a9efdaa95d4b88b392a76f5f7298fd"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "19acd60ee960d11263c9850e12a4de91"
server_key_iv: "e73fb0845b60e5dccd75df6196576148"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.605191 6906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:29.617888 6906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:29.619972 6906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:29.620136 6906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:29.620365 6906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:29.620800 6906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:29.620855 6906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.620889 6906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:29.620918 6906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.626742 6906 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:45771
I20260808 14:39:29.626796 7056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:45771 every 8 connection(s)
I20260808 14:39:29.627115 6906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:39:29.630705 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 6906
I20260808 14:39:29.630827 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:39:29.631036 20804 external_mini_cluster.cc:1428] Setting key 3386fc24c34afb3849e3af24388ef4bb
Aug 08 14:39:29 dist-test-slave-8n49 krb5kdc[6634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199969, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:29.637019 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.627852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:34173 (local address 127.20.81.62:34767)
0808 14:39:29.627917 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:29.627919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:29.628116 (+ 197us) server_negotiation.cc:407] Connection header received
0808 14:39:29.628633 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:29.628634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:29.628645 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:29.628717 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:29.629653 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.630146 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.631326 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.631562 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.631650 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.634117 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:29.634119 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:29.634119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:29.634127 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:29.635492 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.635979 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.635981 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.635981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.636048 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.636311 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.636313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.636313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.636441 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:29.636521 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:29.636842 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 14:39:29.636926 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:39:29.637274 7059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.627812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34767 (local address 127.20.81.2:34173)
0808 14:39:29.627988 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:29.628030 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:29.628521 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:29.628795 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:29.628799 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:29.629373 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:29.629572 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.629577 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.630228 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.630229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.631208 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.631213 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.631685 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.631686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.631837 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.632432 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:29.632441 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:29.634012 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:29.635587 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:29.635595 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:29.635597 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:29.635888 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:29.636129 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:29.636130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:29.636130 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:29.636242 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:29.636513 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:29.636520 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:29.636702 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 14:39:29.636818 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:39:29.636982 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
I20260808 14:39:29.637735 7057 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34767
I20260808 14:39:29.637853 7057 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:29.638072 7057 heartbeater.cc:511] Master 127.20.81.62:34767 requested a full tablet report, sending...
I20260808 14:39:29.638455 6682 ts_manager.cc:194] Registered new tserver with Master: 49a9efdaa95d4b88b392a76f5f7298fd (127.20.81.2:45771)
I20260808 14:39:29.638836 6682 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:34173
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:39:29.659334 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34767
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:29.742916 7062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:29.743124 7062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:29.743148 7062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:29.744313 7062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:29.744356 7062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:29.744382 7062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:39:29.745889 7062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:34767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:29.746162 7062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:29.746403 7062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:29.751551 7070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:29.751562 7067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:29.751631 7062 server_base.cc:1034] running on GCE node
W20260808 14:39:29.751569 7068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:29.751940 7062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:29.752205 7062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:29.753367 7062 hybrid_clock.cc:648] HybridClock initialized: now 1786199969753360 us; error 44 us; skew 500 ppm
Aug 08 14:39:29 dist-test-slave-8n49 krb5kdc[6634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199969, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:29.755875 7062 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:39:29.756261 7062 webserver.cc:460] Webserver started at http://127.20.81.3:41579/ using document root <none> and password file <none>
I20260808 14:39:29.756487 7062 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:29.756532 7062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:29.756717 7062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:29.757786 7062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "4472e63a39e1467ea0a4d5fc96875fff"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "a717672ee30592f21d23930e7df71604"
server_key_iv: "7766fe32aad3442fabba220178879155"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.758141 7062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "4472e63a39e1467ea0a4d5fc96875fff"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "a717672ee30592f21d23930e7df71604"
server_key_iv: "7766fe32aad3442fabba220178879155"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.759487 7062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:29.760331 7080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.760624 7062 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:29.760699 7062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "4472e63a39e1467ea0a4d5fc96875fff"
format_stamp: "Formatted at 2026-08-08 14:39:29 on dist-test-slave-8n49"
server_key: "a717672ee30592f21d23930e7df71604"
server_key_iv: "7766fe32aad3442fabba220178879155"
server_key_version: "encryptionkey@0"
I20260808 14:39:29.760792 7062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:29.802760 7062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:29.804904 7062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:29.805084 7062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:29.805346 7062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:29.805680 7062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:29.805735 7062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.805783 7062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:29.805806 7062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:29.811700 7062 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:35835
I20260808 14:39:29.811741 7207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:35835 every 8 connection(s)
I20260808 14:39:29.812112 7062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:39:29.815172 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 7062
I20260808 14:39:29.815271 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:39:29.815474 20804 external_mini_cluster.cc:1428] Setting key 8d3d4d04c92fb8d83709b92457dd3c2e
Aug 08 14:39:29 dist-test-slave-8n49 krb5kdc[6634](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199969, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:29.822383 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.812982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:57515 (local address 127.20.81.62:34767)
0808 14:39:29.813085 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:29.813088 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:29.813263 (+ 175us) server_negotiation.cc:407] Connection header received
0808 14:39:29.813862 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:29.813864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:29.813879 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:29.813941 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:29.815013 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.815821 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.817023 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.817263 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.817352 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.819468 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:29.819469 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:29.819469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:29.819477 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:29.821005 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.821399 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.821400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.821400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.821463 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.821712 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.821713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.821713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.821817 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:29.821882 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:29.822220 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 14:39:29.822311 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:39:29.822449 7210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.812895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:34767 (local address 127.20.81.3:57515)
0808 14:39:29.813116 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:29.813168 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:29.813738 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:29.814035 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:29.814040 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:29.814676 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:29.814888 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.814893 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.815939 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.815940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.816926 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.816929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.817358 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.817359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.817498 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.817980 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:29.817989 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:29.819383 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:29.821085 (+ 1702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:29.821092 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:29.821094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:29.821325 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:29.821547 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:29.821548 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:29.821548 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:29.821652 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:29.821914 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:29.821920 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:29.822054 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 14:39:29.822155 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:39:29.822280 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":110,"threads_started":1}
I20260808 14:39:29.822988 7208 heartbeater.cc:347] Connected to a master server at 127.20.81.62:34767
I20260808 14:39:29.823083 7208 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:29.823235 7208 heartbeater.cc:511] Master 127.20.81.62:34767 requested a full tablet report, sending...
I20260808 14:39:29.823590 6682 ts_manager.cc:194] Registered new tserver with Master: 4472e63a39e1467ea0a4d5fc96875fff (127.20.81.3:35835)
I20260808 14:39:29.823974 6682 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:57515
I20260808 14:39:29.827005 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:39:29.834322 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.828313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35384 (local address 127.20.81.62:34767)
0808 14:39:29.828371 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:29.828373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:29.828486 (+ 113us) server_negotiation.cc:407] Connection header received
0808 14:39:29.828592 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:29.828593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:29.828602 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:29.828647 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:29.829179 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.829651 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.830393 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.830602 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.830691 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.831769 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:29.831770 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:29.831771 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:29.831778 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:29.833135 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.833500 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.833501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.833502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.833566 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:29.833771 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:29.833772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:29.833772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:29.833922 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:29.834036 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:29.834145 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 14:39:29.834223 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:39:29.835719 6682 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35384:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:39:29.837375 6682 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:39:29.843984 7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.839799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40684 (local address 127.20.81.2:45771)
0808 14:39:29.840572 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:29.840576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:29.840586 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:39:29.840625 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:29.840627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:29.840641 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:29.840719 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:29.840852 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.841550 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.843094 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.843587 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.843677 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.843740 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:29.843854 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 14:39:29.843895 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":86,"threads_started":1}
I20260808 14:39:29.843972 7220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.839659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:45771 (local address 127.0.0.1:40684)
0808 14:39:29.839832 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:29.839873 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:29.839936 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:29.840717 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:29.840717 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:29.840719 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:29.840773 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.840775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.841662 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.841663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.842989 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.842992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.843677 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.843679 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.843759 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.843773 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:39:29.843842 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:39:29.843894 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":51,"thread_start_us":65,"threads_started":1}
I20260808 14:39:29.844120 7224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.839864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:35835 (local address 127.0.0.1:38186)
0808 14:39:29.840068 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:29.840080 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:29.840121 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:29.840432 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:29.840432 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:29.840433 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:29.840524 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.840526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.841922 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.841924 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.843053 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.843056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.843891 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.843892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.843942 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.843946 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:29.843976 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 14:39:29.844026 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":8,"thread_start_us":72,"threads_started":1}
I20260808 14:39:29.844262 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.839659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35115 (local address 127.0.0.1:59130)
0808 14:39:29.839990 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:29.840001 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:29.840074 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:29.840426 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:29.840429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:29.840432 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:29.840599 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.840601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.841942 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.841943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.842863 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:29.842865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.843849 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.843851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:29.843923 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.843927 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:29.843976 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:39:29.844026 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":93,"spinlock_wait_cycles":768,"thread_start_us":98,"threads_started":1}
I20260808 14:39:29.844274 7223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.839799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59130 (local address 127.20.81.1:35115)
0808 14:39:29.840225 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:29.840230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:29.840240 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:39:29.840281 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:29.840283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:29.840298 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:29.840402 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:29.840689 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.841839 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.842950 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.843679 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.843753 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.843811 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:29.844073 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 14:39:29.844118 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":101,"threads_started":1}
I20260808 14:39:29.844774 7225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:29.840085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38186 (local address 127.20.81.3:35835)
0808 14:39:29.840245 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:29.840269 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:29.840278 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:29.840319 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:29.840321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:29.840337 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:29.840637 (+ 300us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:29.840711 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.841813 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.843137 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:29.843803 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:29.844521 (+ 718us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:29.844609 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:29.844637 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 14:39:29.844688 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
I20260808 14:39:29.845197 6979 tablet_service.cc:1467] Processing CreateTablet for tablet 2cb504d963cc4557851279bf908d9cd8 (DEFAULT_TABLE table=test-table [id=17f4bdcfb4704b5e92af64fa23ee9279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:29.845196 6823 tablet_service.cc:1467] Processing CreateTablet for tablet 2cb504d963cc4557851279bf908d9cd8 (DEFAULT_TABLE table=test-table [id=17f4bdcfb4704b5e92af64fa23ee9279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:29.845432 7137 tablet_service.cc:1467] Processing CreateTablet for tablet 2cb504d963cc4557851279bf908d9cd8 (DEFAULT_TABLE table=test-table [id=17f4bdcfb4704b5e92af64fa23ee9279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:29.845588 6979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cb504d963cc4557851279bf908d9cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:29.845588 6823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cb504d963cc4557851279bf908d9cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:29.845767 7137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cb504d963cc4557851279bf908d9cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:29.848572 7227 tablet_bootstrap.cc:492] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: Bootstrap starting.
I20260808 14:39:29.848985 7228 tablet_bootstrap.cc:492] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: Bootstrap starting.
I20260808 14:39:29.849299 7227 tablet_bootstrap.cc:654] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:29.849696 7228 tablet_bootstrap.cc:654] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:29.849907 7227 log.cc:824] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:29.850275 7228 log.cc:824] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:29.850591 7229 tablet_bootstrap.cc:492] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f: Bootstrap starting.
I20260808 14:39:29.850768 7227 tablet_bootstrap.cc:492] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: No bootstrap required, opened a new log
I20260808 14:39:29.850878 7227 ts_tablet_manager.cc:1397] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:39:29.850992 7228 tablet_bootstrap.cc:492] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: No bootstrap required, opened a new log
I20260808 14:39:29.851087 7228 ts_tablet_manager.cc:1397] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:39:29.851276 7229 tablet_bootstrap.cc:654] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:29.851747 7229 log.cc:824] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:29.852437 7229 tablet_bootstrap.cc:492] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f: No bootstrap required, opened a new log
I20260808 14:39:29.852519 7229 ts_tablet_manager.cc:1397] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:39:29.852962 7227 raft_consensus.cc:348] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } }
I20260808 14:39:29.853025 7228 raft_consensus.cc:348] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } }
I20260808 14:39:29.853156 7227 raft_consensus.cc:374] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:29.853195 7227 raft_consensus.cc:729] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4472e63a39e1467ea0a4d5fc96875fff, State: Initialized, Role: FOLLOWER
I20260808 14:39:29.853223 7228 raft_consensus.cc:374] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:29.853266 7228 raft_consensus.cc:729] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49a9efdaa95d4b88b392a76f5f7298fd, State: Initialized, Role: FOLLOWER
I20260808 14:39:29.853379 7227 consensus_queue.cc:260] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } }
I20260808 14:39:29.853379 7228 consensus_queue.cc:260] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } }
I20260808 14:39:29.853677 7227 ts_tablet_manager.cc:1428] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:39:29.853677 7228 ts_tablet_manager.cc:1428] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:39:29.853765 7057 heartbeater.cc:503] Master 127.20.81.62:34767 was elected leader, sending a full tablet report...
I20260808 14:39:29.854095 7208 heartbeater.cc:503] Master 127.20.81.62:34767 was elected leader, sending a full tablet report...
I20260808 14:39:29.854475 7229 raft_consensus.cc:348] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } }
I20260808 14:39:29.854653 7229 raft_consensus.cc:374] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:29.854696 7229 raft_consensus.cc:729] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae94fa65714449bb7d68f1a7788191f, State: Initialized, Role: FOLLOWER
I20260808 14:39:29.854815 7229 consensus_queue.cc:260] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } }
I20260808 14:39:29.855129 6900 heartbeater.cc:503] Master 127.20.81.62:34767 was elected leader, sending a full tablet report...
I20260808 14:39:29.855132 7229 ts_tablet_manager.cc:1428] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260808 14:39:29.877677 7058 tablet.cc:2369] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:39:29.978035 6901 tablet.cc:2369] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:39:30.062714 7209 tablet.cc:2369] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:39:30.066860 7235 raft_consensus.cc:482] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:30.066987 7235 raft_consensus.cc:504] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } }
I20260808 14:39:30.067447 7235 leader_election.cc:288] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49a9efdaa95d4b88b392a76f5f7298fd (127.20.81.2:45771), 4472e63a39e1467ea0a4d5fc96875fff (127.20.81.3:35835)
I20260808 14:39:30.070408 7225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.067718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:55225 (local address 127.20.81.3:35835)
0808 14:39:30.067770 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.067773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.067876 (+ 103us) server_negotiation.cc:407] Connection header received
0808 14:39:30.067967 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.067968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.067978 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.068040 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:30.068219 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.068712 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.069674 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.070061 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.070145 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.070157 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.070302 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.070341 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:39:30.070422 7237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.067629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:35835 (local address 127.20.81.1:55225)
0808 14:39:30.067791 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.067802 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.067889 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.068046 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.068047 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.068065 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:30.068140 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.068141 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.068798 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.068799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.069577 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.069579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.070148 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.070150 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.070227 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.070230 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.070296 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.070336 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":101,"threads_started":1}
I20260808 14:39:30.070479 7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.067762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:50635 (local address 127.20.81.2:45771)
0808 14:39:30.067808 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.067810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.067867 (+ 57us) server_negotiation.cc:407] Connection header received
0808 14:39:30.067951 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.067952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.067963 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.068036 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:30.068245 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.068791 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.069725 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.070114 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.070200 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.070211 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.070364 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.070401 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:39:30.070554 7236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.067638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:45771 (local address 127.20.81.1:50635)
0808 14:39:30.067804 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.067816 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.067884 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.068043 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.068044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.068062 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:30.068162 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.068164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.068882 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.068883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.069629 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.069631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.070205 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.070206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.070277 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.070283 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.070356 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.070401 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":13,"thread_start_us":90,"threads_started":1}
I20260808 14:39:30.070952 7003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cb504d963cc4557851279bf908d9cd8" candidate_uuid: "bae94fa65714449bb7d68f1a7788191f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" is_pre_election: true
I20260808 14:39:30.070984 7158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cb504d963cc4557851279bf908d9cd8" candidate_uuid: "bae94fa65714449bb7d68f1a7788191f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4472e63a39e1467ea0a4d5fc96875fff" is_pre_election: true
I20260808 14:39:30.071121 7003 raft_consensus.cc:2454] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae94fa65714449bb7d68f1a7788191f in term 0.
I20260808 14:39:30.071143 7158 raft_consensus.cc:2454] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae94fa65714449bb7d68f1a7788191f in term 0.
I20260808 14:39:30.071380 6772 leader_election.cc:302] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49a9efdaa95d4b88b392a76f5f7298fd, bae94fa65714449bb7d68f1a7788191f; no voters:
I20260808 14:39:30.071525 7235 raft_consensus.cc:2781] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:39:30.071586 7235 raft_consensus.cc:482] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:39:30.071610 7235 raft_consensus.cc:3037] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:30.072299 7235 raft_consensus.cc:504] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } }
I20260808 14:39:30.072438 7235 leader_election.cc:288] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [CANDIDATE]: Term 1 election: Requested vote from peers 49a9efdaa95d4b88b392a76f5f7298fd (127.20.81.2:45771), 4472e63a39e1467ea0a4d5fc96875fff (127.20.81.3:35835)
I20260808 14:39:30.072618 7003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cb504d963cc4557851279bf908d9cd8" candidate_uuid: "bae94fa65714449bb7d68f1a7788191f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49a9efdaa95d4b88b392a76f5f7298fd"
I20260808 14:39:30.072638 7158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cb504d963cc4557851279bf908d9cd8" candidate_uuid: "bae94fa65714449bb7d68f1a7788191f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4472e63a39e1467ea0a4d5fc96875fff"
I20260808 14:39:30.072714 7003 raft_consensus.cc:3037] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:30.072717 7158 raft_consensus.cc:3037] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:30.073457 7003 raft_consensus.cc:2454] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae94fa65714449bb7d68f1a7788191f in term 1.
I20260808 14:39:30.073472 7158 raft_consensus.cc:2454] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae94fa65714449bb7d68f1a7788191f in term 1.
I20260808 14:39:30.073668 6772 leader_election.cc:302] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49a9efdaa95d4b88b392a76f5f7298fd, bae94fa65714449bb7d68f1a7788191f; no voters:
I20260808 14:39:30.073774 7235 raft_consensus.cc:2781] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:30.073928 7235 raft_consensus.cc:686] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [term 1 LEADER]: Becoming Leader. State: Replica: bae94fa65714449bb7d68f1a7788191f, State: Running, Role: LEADER
I20260808 14:39:30.074143 7235 consensus_queue.cc:237] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } }
I20260808 14:39:30.075040 6682 catalog_manager.cc:5495] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f reported cstate change: term changed from 0 to 1, leader changed from <none> to bae94fa65714449bb7d68f1a7788191f (127.20.81.1). New cstate: current_term: 1 leader_uuid: "bae94fa65714449bb7d68f1a7788191f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae94fa65714449bb7d68f1a7788191f" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 } health_report { overall_health: UNKNOWN } } }
I20260808 14:39:30.125630 7223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.123409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59146 (local address 127.20.81.1:35115)
0808 14:39:30.123476 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.123478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.123489 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:39:30.123530 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.123531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.123553 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.123618 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:39:30.123750 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.124217 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.124941 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.125128 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.125182 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.125318 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:39:30.125417 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:39:30.125484 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.125506 (+ 22us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.125522 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:39:30.127547 7003 raft_consensus.cc:1261] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [term 1 FOLLOWER]: Refusing update from remote peer bae94fa65714449bb7d68f1a7788191f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:30.127560 7158 raft_consensus.cc:1261] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [term 1 FOLLOWER]: Refusing update from remote peer bae94fa65714449bb7d68f1a7788191f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:30.127909 7235 consensus_queue.cc:1035] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [LEADER]: Connected to new peer: Peer: permanent_uuid: "49a9efdaa95d4b88b392a76f5f7298fd" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:30.128065 7238 consensus_queue.cc:1035] T 2cb504d963cc4557851279bf908d9cd8 P bae94fa65714449bb7d68f1a7788191f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4472e63a39e1467ea0a4d5fc96875fff" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:30.130769 7242 mvcc.cc:205] Tried to move back new op lower bound from 7316275077639811072 to 7316275077424451584. Current Snapshot: MvccSnapshot[applied={T|T < 7316275077639811072}]
I20260808 14:39:30.132905 6681 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:30.132997 6681 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:30.133778 6681 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f45e7a03f3146919f4a74089f3bf5aa: Sending DeleteTablet for 3 replicas of tablet 2cb504d963cc4557851279bf908d9cd8
I20260808 14:39:30.134117 6979 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cb504d963cc4557851279bf908d9cd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:30 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:40684
I20260808 14:39:30.134169 7137 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cb504d963cc4557851279bf908d9cd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:30 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:38186
I20260808 14:39:30.134375 6823 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cb504d963cc4557851279bf908d9cd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:30 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:59130
I20260808 14:39:30.134465 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 6754
I20260808 14:39:30.134589 7251 tablet_replica.cc:330] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: stopping tablet replica
I20260808 14:39:30.134684 7251 raft_consensus.cc:2229] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:30.134778 7251 raft_consensus.cc:2258] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:30.134913 7250 tablet_replica.cc:330] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: stopping tablet replica
I20260808 14:39:30.134994 7250 raft_consensus.cc:2229] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:30.135095 7250 raft_consensus.cc:2258] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:30.135818 7251 ts_tablet_manager.cc:1905] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:30.136343 7250 ts_tablet_manager.cc:1905] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:30.137383 7251 ts_tablet_manager.cc:1918] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:30.137531 7251 log.cc:1196] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/2cb504d963cc4557851279bf908d9cd8
I20260808 14:39:30.137840 7251 ts_tablet_manager.cc:1939] T 2cb504d963cc4557851279bf908d9cd8 P 4472e63a39e1467ea0a4d5fc96875fff: Deleting consensus metadata
I20260808 14:39:30.138338 6665 catalog_manager.cc:4841] TS 4472e63a39e1467ea0a4d5fc96875fff (127.20.81.3:35835): tablet 2cb504d963cc4557851279bf908d9cd8 (table test-table [id=17f4bdcfb4704b5e92af64fa23ee9279]) successfully deleted
I20260808 14:39:30.138404 7250 ts_tablet_manager.cc:1918] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:30.138509 7250 log.cc:1196] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/2cb504d963cc4557851279bf908d9cd8
I20260808 14:39:30.138767 7250 ts_tablet_manager.cc:1939] T 2cb504d963cc4557851279bf908d9cd8 P 49a9efdaa95d4b88b392a76f5f7298fd: Deleting consensus metadata
I20260808 14:39:30.139358 6666 catalog_manager.cc:4841] TS 49a9efdaa95d4b88b392a76f5f7298fd (127.20.81.2:45771): tablet 2cb504d963cc4557851279bf908d9cd8 (table test-table [id=17f4bdcfb4704b5e92af64fa23ee9279]) successfully deleted
W20260808 14:39:30.143249 6665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:35115 (error 108)
I20260808 14:39:30.143573 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 6906
I20260808 14:39:30.144371 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.143685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:35115 (local address 127.0.0.1:59162)
0808 14:39:30.144290 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.144345 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":584}
W20260808 14:39:30.144488 6665 catalog_manager.cc:4584] TS bae94fa65714449bb7d68f1a7788191f (127.20.81.1:35115): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2cb504d963cc4557851279bf908d9cd8: Network error: Client connection negotiation failed: client connection to 127.20.81.1:35115: connect: Connection refused (error 111)
I20260808 14:39:30.150755 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 7062
I20260808 14:39:30.156395 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 6648
2026-08-08T14:39:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2256 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T14:39:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:30Z Disabled control of system clock
I20260808 14:39:30.185523 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:38587
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:33161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:38587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:39:30.281741 7257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:30.281955 7257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:30.281975 7257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:30.283049 7257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:30.283085 7257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:30.283098 7257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:30.283111 7257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:30.283123 7257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:30.284376 7257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:38587
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:38587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:30.284659 7257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:30.284912 7257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:30.289727 7266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:30.289762 7264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:30.289764 7263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:30.289855 7257 server_base.cc:1034] running on GCE node
I20260808 14:39:30.290335 7257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:30.290688 7257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:30.291838 7257 hybrid_clock.cc:648] HybridClock initialized: now 1786199970291827 us; error 36 us; skew 500 ppm
I20260808 14:39:30.293179 7257 webserver.cc:460] Webserver started at http://127.20.81.62:39347/ using document root <none> and password file <none>
I20260808 14:39:30.293442 7257 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:30.293527 7257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:30.293681 7257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:30.294719 7257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "2fb7d25c5f2e4c14968091132f6b08c8"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "59a7127c73aed19a5b67866ffba54a4c"
server_key_iv: "5c9046bf96d2bbf0f0f1234ec15f011b"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.295089 7257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "2fb7d25c5f2e4c14968091132f6b08c8"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "59a7127c73aed19a5b67866ffba54a4c"
server_key_iv: "5c9046bf96d2bbf0f0f1234ec15f011b"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.296384 7257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:39:30.297187 7274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.297369 7257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:39:30.297470 7257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "2fb7d25c5f2e4c14968091132f6b08c8"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "59a7127c73aed19a5b67866ffba54a4c"
server_key_iv: "5c9046bf96d2bbf0f0f1234ec15f011b"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.297561 7257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:30.320078 7257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:30.320403 7257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:30.320611 7257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:30.324810 7257 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:38587
I20260808 14:39:30.324847 7335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:38587 every 8 connection(s)
I20260808 14:39:30.325212 7257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:30.326243 7336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:30.328596 7336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8: Bootstrap starting.
I20260808 14:39:30.329198 7336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:30.329509 7336 log.cc:824] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:30.330093 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 7257
I20260808 14:39:30.330224 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:30.330317 7336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8: No bootstrap required, opened a new log
I20260808 14:39:30.330471 20804 external_mini_cluster.cc:1428] Setting key 738d38565984fbb0714dac45d18f6066
I20260808 14:39:30.333039 7336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb7d25c5f2e4c14968091132f6b08c8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38587 } }
I20260808 14:39:30.333233 7336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:30.333272 7336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb7d25c5f2e4c14968091132f6b08c8, State: Initialized, Role: FOLLOWER
I20260808 14:39:30.333396 7336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb7d25c5f2e4c14968091132f6b08c8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38587 } }
I20260808 14:39:30.333470 7336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:30.333499 7336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:30.333544 7336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:30.334215 7336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb7d25c5f2e4c14968091132f6b08c8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38587 } }
I20260808 14:39:30.334347 7336 leader_election.cc:302] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fb7d25c5f2e4c14968091132f6b08c8; no voters:
I20260808 14:39:30.334553 7336 leader_election.cc:288] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:30.334596 7341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:30.334746 7341 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb7d25c5f2e4c14968091132f6b08c8, State: Running, Role: LEADER
I20260808 14:39:30.334831 7336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:30.334916 7341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb7d25c5f2e4c14968091132f6b08c8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38587 } }
I20260808 14:39:30.335233 7341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fb7d25c5f2e4c14968091132f6b08c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb7d25c5f2e4c14968091132f6b08c8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38587 } } }
I20260808 14:39:30.335397 7341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:30.335605 7341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fb7d25c5f2e4c14968091132f6b08c8. Latest consensus state: current_term: 1 leader_uuid: "2fb7d25c5f2e4c14968091132f6b08c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb7d25c5f2e4c14968091132f6b08c8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 38587 } } }
I20260808 14:39:30.335732 7341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:30.336699 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.331042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52268 (local address 127.20.81.62:38587)
0808 14:39:30.331225 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.331232 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.331256 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:39:30.331677 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.331683 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.331739 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.331846 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:30.332095 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.333054 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.334149 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.334688 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.334808 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.335795 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:30.335799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:30.335799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:30.336047 (+ 248us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:30.336093 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:30.336111 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:30.336183 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.336294 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.336376 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":74,"threads_started":1}
I20260808 14:39:30.336323 7351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:30.337263 7351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:30.338806 7351 catalog_manager.cc:1347] Generated new cluster ID: af0273a657a2429da92cc6d64a74865a
I20260808 14:39:30.338871 7351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:30.361474 7351 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:30.362185 7351 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:30.370035 7351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8: Generated new TSK 0
I20260808 14:39:30.370216 7351 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:30.376672 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38587
--builtin_ntp_servers=127.20.81.20:33161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:39:30.459522 7364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:30.459722 7364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:30.459744 7364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:30.460974 7364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:30.461015 7364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:30.461041 7364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:39:30.462697 7364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:30.462961 7364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:30.463264 7364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:30.468221 7370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:30.468221 7371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:30.468281 7364 server_base.cc:1034] running on GCE node
W20260808 14:39:30.468247 7373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:30.468694 7364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:30.468889 7364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:30.470041 7364 hybrid_clock.cc:648] HybridClock initialized: now 1786199970470030 us; error 28 us; skew 500 ppm
I20260808 14:39:30.471359 7364 webserver.cc:460] Webserver started at http://127.20.81.1:38673/ using document root <none> and password file <none>
I20260808 14:39:30.471616 7364 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:30.471665 7364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:30.471827 7364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:30.473038 7364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "56867db319b34dac836bf75774031eb5"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "ef2207b6466c4d229f36294a9d540b02"
server_key_iv: "0628ace0eea4f83314a4511445ff1067"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.473404 7364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "56867db319b34dac836bf75774031eb5"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "ef2207b6466c4d229f36294a9d540b02"
server_key_iv: "0628ace0eea4f83314a4511445ff1067"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.474740 7364 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:30.475524 7379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.475730 7364 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:30.475823 7364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "56867db319b34dac836bf75774031eb5"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "ef2207b6466c4d229f36294a9d540b02"
server_key_iv: "0628ace0eea4f83314a4511445ff1067"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.475898 7364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:30.488591 7364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:30.488890 7364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:30.489027 7364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:30.489244 7364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:30.489562 7364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:30.489595 7364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.489616 7364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:30.489660 7364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.495270 7364 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:39687
I20260808 14:39:30.495313 7510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:39687 every 8 connection(s)
I20260808 14:39:30.495668 7364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:39:30.501019 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.496363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:57569 (local address 127.20.81.62:38587)
0808 14:39:30.496408 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.496410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.496674 (+ 264us) server_negotiation.cc:407] Connection header received
0808 14:39:30.497215 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.497216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.497235 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.497303 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:30.497986 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.498511 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.499489 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.499708 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.499788 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.500715 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:30.500716 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:30.500717 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:30.500722 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:30.500737 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:30.500741 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:30.500812 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.500909 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.500935 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:39:30.501227 7513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.496352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:38587 (local address 127.20.81.1:57569)
0808 14:39:30.496520 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.496597 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.497107 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.497369 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.497373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.497382 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:30.497887 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.497891 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.498612 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.498613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.499392 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.499394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.499797 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.499799 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.499937 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.500519 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:39:30.500520 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:30.500605 (+ 85us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:39:30.500629 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:30.500812 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:30.500819 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:30.500822 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.500910 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.501018 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":73,"threads_started":1}
I20260808 14:39:30.501775 7511 heartbeater.cc:347] Connected to a master server at 127.20.81.62:38587
I20260808 14:39:30.501880 7511 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:30.502095 7511 heartbeater.cc:511] Master 127.20.81.62:38587 requested a full tablet report, sending...
I20260808 14:39:30.502507 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 7364
I20260808 14:39:30.502599 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:39:30.502766 20804 external_mini_cluster.cc:1428] Setting key c5082d9c6c466708b51c0360b77e2128
I20260808 14:39:30.503177 7295 ts_manager.cc:194] Registered new tserver with Master: 56867db319b34dac836bf75774031eb5 (127.20.81.1:39687)
I20260808 14:39:30.503744 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38587
--builtin_ntp_servers=127.20.81.20:33161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:39:30.503937 7295 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.1:57569
W20260808 14:39:30.585523 7514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:30.585762 7514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:30.585800 7514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:30.586946 7514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:30.587013 7514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:30.587054 7514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:39:30.588582 7514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:30.588850 7514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:30.589164 7514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:39:30.594307 7514 server_base.cc:1034] running on GCE node
W20260808 14:39:30.594290 7520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:30.594291 7519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:30.594285 7522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:30.594781 7514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:30.595077 7514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:30.596244 7514 hybrid_clock.cc:648] HybridClock initialized: now 1786199970596242 us; error 39 us; skew 500 ppm
I20260808 14:39:30.597676 7514 webserver.cc:460] Webserver started at http://127.20.81.2:39921/ using document root <none> and password file <none>
I20260808 14:39:30.597951 7514 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:30.598027 7514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:30.598176 7514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:30.599246 7514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "8578bb0bfeb5476895deed26c6d366fa"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "d3711274d9d7eba5b9085180ca43c25c"
server_key_iv: "3faeb17199021315caf59d713304961e"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.599654 7514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "8578bb0bfeb5476895deed26c6d366fa"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "d3711274d9d7eba5b9085180ca43c25c"
server_key_iv: "3faeb17199021315caf59d713304961e"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.601194 7514 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:39:30.602028 7528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.602211 7514 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:30.602312 7514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "8578bb0bfeb5476895deed26c6d366fa"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "d3711274d9d7eba5b9085180ca43c25c"
server_key_iv: "3faeb17199021315caf59d713304961e"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.602402 7514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:30.622102 7514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:30.622442 7514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:30.622607 7514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:30.622867 7514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:30.623205 7514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:30.623260 7514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.623302 7514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:30.623350 7514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.629215 7514 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:36567
I20260808 14:39:30.629261 7656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:36567 every 8 connection(s)
I20260808 14:39:30.629654 7514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:39:30.634944 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.630484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:55339 (local address 127.20.81.62:38587)
0808 14:39:30.630566 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.630569 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.630808 (+ 239us) server_negotiation.cc:407] Connection header received
0808 14:39:30.631302 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.631303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.631314 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.631368 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:30.632021 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.632526 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.633584 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.633766 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.633818 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.634679 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:30.634680 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:30.634680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:30.634684 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:30.634699 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:30.634702 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:30.634747 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.634856 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.634880 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:39:30.635179 7659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.630475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:38587 (local address 127.20.81.2:55339)
0808 14:39:30.630678 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.630716 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.631213 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.631423 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.631426 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.631435 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:30.631948 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.631952 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.632660 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.632661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.633493 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.633495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.633841 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.633842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.633951 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.634539 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:39:30.634540 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:30.634569 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:39:30.634594 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:30.634769 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:30.634773 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:30.634776 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.634847 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.634927 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":116,"threads_started":1}
I20260808 14:39:30.635782 7657 heartbeater.cc:347] Connected to a master server at 127.20.81.62:38587
I20260808 14:39:30.635906 7657 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:30.636099 7657 heartbeater.cc:511] Master 127.20.81.62:38587 requested a full tablet report, sending...
I20260808 14:39:30.636502 7295 ts_manager.cc:194] Registered new tserver with Master: 8578bb0bfeb5476895deed26c6d366fa (127.20.81.2:36567)
I20260808 14:39:30.636911 7295 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.2:55339
I20260808 14:39:30.639533 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 7514
I20260808 14:39:30.639669 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:39:30.639878 20804 external_mini_cluster.cc:1428] Setting key f95b385ef3fdc18f93227baae069e876
I20260808 14:39:30.640851 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38587
--builtin_ntp_servers=127.20.81.20:33161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:39:30.724061 7660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:30.724298 7660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:30.724334 7660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:30.725487 7660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:30.725556 7660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:30.725600 7660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:39:30.726955 7660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:38587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:30.727240 7660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:30.727557 7660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:30.732632 7668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:30.732662 7665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:30.732640 7666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:30.732774 7660 server_base.cc:1034] running on GCE node
I20260808 14:39:30.733044 7660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:30.733286 7660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:30.734452 7660 hybrid_clock.cc:648] HybridClock initialized: now 1786199970734436 us; error 44 us; skew 500 ppm
I20260808 14:39:30.735945 7660 webserver.cc:460] Webserver started at http://127.20.81.3:33059/ using document root <none> and password file <none>
I20260808 14:39:30.736254 7660 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:30.736304 7660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:30.736397 7660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:30.737512 7660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "9af1def4dfec4e319dc2bb1cce31be77"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "06fa5cdceaabe96839821bfc39754f61"
server_key_iv: "4b64343b6f0dae95e2e0d3937d8cc8f0"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.737818 7660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "9af1def4dfec4e319dc2bb1cce31be77"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "06fa5cdceaabe96839821bfc39754f61"
server_key_iv: "4b64343b6f0dae95e2e0d3937d8cc8f0"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.739099 7660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:39:30.739751 7675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.739938 7660 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:30.740008 7660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "9af1def4dfec4e319dc2bb1cce31be77"
format_stamp: "Formatted at 2026-08-08 14:39:30 on dist-test-slave-8n49"
server_key: "06fa5cdceaabe96839821bfc39754f61"
server_key_iv: "4b64343b6f0dae95e2e0d3937d8cc8f0"
server_key_version: "encryptionkey@0"
I20260808 14:39:30.740090 7660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:30.751230 7660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:30.751508 7660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:30.751660 7660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:30.751878 7660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:30.752218 7660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:30.752254 7660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.752274 7660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:30.752326 7660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:30.758260 7660 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:40171
I20260808 14:39:30.758299 7808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:40171 every 8 connection(s)
I20260808 14:39:30.758638 7660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:39:30.763640 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.759411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:40981 (local address 127.20.81.62:38587)
0808 14:39:30.759486 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.759489 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.759714 (+ 225us) server_negotiation.cc:407] Connection header received
0808 14:39:30.760195 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.760196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.760206 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.760249 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:30.760966 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.761449 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.762380 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.762561 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.762612 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.763437 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:30.763438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:30.763438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:30.763442 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:30.763452 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:30.763455 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:30.763492 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.763553 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.763579 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:39:30.763833 7811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.759405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:38587 (local address 127.20.81.3:40981)
0808 14:39:30.759596 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.759630 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.760097 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.760302 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.760305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.760312 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:30.760890 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.760896 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.761528 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.761529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.762307 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.762309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.762635 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.762636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.762745 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.763314 (+ 569us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:39:30.763315 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:30.763342 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:39:30.763365 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:30.763494 (+ 129us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:30.763496 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:30.763498 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.763544 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.763619 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260808 14:39:30.764322 7809 heartbeater.cc:347] Connected to a master server at 127.20.81.62:38587
I20260808 14:39:30.764423 7809 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:30.764667 7809 heartbeater.cc:511] Master 127.20.81.62:38587 requested a full tablet report, sending...
I20260808 14:39:30.765066 7295 ts_manager.cc:194] Registered new tserver with Master: 9af1def4dfec4e319dc2bb1cce31be77 (127.20.81.3:40171)
I20260808 14:39:30.765427 7295 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.3:40981
I20260808 14:39:30.766111 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 7660
I20260808 14:39:30.766227 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:39:30.766440 20804 external_mini_cluster.cc:1428] Setting key 2cd076f6c081c34213a831d6135f654b
I20260808 14:39:30.767320 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:39:30.771548 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.768728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52276 (local address 127.20.81.62:38587)
0808 14:39:30.768797 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.768799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.768892 (+ 93us) server_negotiation.cc:407] Connection header received
0808 14:39:30.768969 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.768970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.768979 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.769028 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:30.769210 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.769674 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.770409 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.770619 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.770704 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.771308 (+ 604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:30.771309 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:30.771310 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:30.771315 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:30.771328 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:30.771332 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:30.771386 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.771445 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.771465 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:39:30.772979 7295 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:39:30.774477 7295 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:39:30.780853 7818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.776662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:40171 (local address 127.0.0.1:46180)
0808 14:39:30.776781 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.776824 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.776893 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.777605 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.777606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.777607 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:30.777641 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.777643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.778575 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.778576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.779892 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.779894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.780547 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.780548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.780644 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.780657 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.780727 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.780781 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":3,"thread_start_us":62,"threads_started":1}
I20260808 14:39:30.780865 7822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.776740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46180 (local address 127.20.81.3:40171)
0808 14:39:30.777165 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.777169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.777178 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:30.777211 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.777213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.777228 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.777610 (+ 382us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:30.777697 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.778490 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.779975 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.780453 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.780547 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.780682 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.780738 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.780774 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":100,"threads_started":1}
I20260808 14:39:30.781026 7819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.776662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:39687 (local address 127.0.0.1:39564)
0808 14:39:30.776832 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.776843 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.776894 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.777312 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.777315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.777317 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:30.777388 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.777390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.778761 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.778761 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.779845 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.779848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.780759 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.780761 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.780825 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.780832 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.780862 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.780906 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":4,"spinlock_wait_cycles":896,"thread_start_us":88,"threads_started":1}
I20260808 14:39:30.781213 7825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.777051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57772 (local address 127.20.81.2:36567)
0808 14:39:30.777277 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.777282 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.777292 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:39:30.777328 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.777330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.777345 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.777433 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:30.777543 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.778696 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.779787 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.780544 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.780649 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.780747 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.781089 (+ 342us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.781136 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":89,"threads_started":1}
I20260808 14:39:30.781608 7823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.776866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:36567 (local address 127.0.0.1:57772)
0808 14:39:30.777075 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.777086 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.777133 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.777428 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.777429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.777431 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:30.777477 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.777478 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.778782 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.778783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.779691 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.779693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.780777 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.780778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.780825 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.780831 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.780879 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.781041 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":1,"thread_start_us":58,"threads_started":1}
I20260808 14:39:30.781586 7728 tablet_service.cc:1467] Processing CreateTablet for tablet 11495e00cbb44a5f9aa1ed3a06565cf6 (DEFAULT_TABLE table=test-table [id=d767de6b7c0e47fe9055e6e40fd0f0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:30.781982 7728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11495e00cbb44a5f9aa1ed3a06565cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:30.782214 7824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.776938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39564 (local address 127.20.81.1:39687)
0808 14:39:30.777116 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.777121 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.777132 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:39:30.777177 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.777179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.777196 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.777286 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:30.777492 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.778672 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.779944 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.780665 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.781972 (+ 1307us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.782068 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.782097 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.782142 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260808 14:39:30.782325 7580 tablet_service.cc:1467] Processing CreateTablet for tablet 11495e00cbb44a5f9aa1ed3a06565cf6 (DEFAULT_TABLE table=test-table [id=d767de6b7c0e47fe9055e6e40fd0f0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:30.782666 7580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11495e00cbb44a5f9aa1ed3a06565cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:30.785184 7436 tablet_service.cc:1467] Processing CreateTablet for tablet 11495e00cbb44a5f9aa1ed3a06565cf6 (DEFAULT_TABLE table=test-table [id=d767de6b7c0e47fe9055e6e40fd0f0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:30.785521 7436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11495e00cbb44a5f9aa1ed3a06565cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:30.786068 7827 tablet_bootstrap.cc:492] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: Bootstrap starting.
I20260808 14:39:30.786337 7826 tablet_bootstrap.cc:492] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: Bootstrap starting.
I20260808 14:39:30.786815 7827 tablet_bootstrap.cc:654] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:30.786990 7826 tablet_bootstrap.cc:654] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:30.787163 7827 log.cc:824] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:30.787333 7826 log.cc:824] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:30.788094 7827 tablet_bootstrap.cc:492] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: No bootstrap required, opened a new log
I20260808 14:39:30.788147 7827 ts_tablet_manager.cc:1397] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:39:30.788707 7826 tablet_bootstrap.cc:492] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: No bootstrap required, opened a new log
I20260808 14:39:30.788893 7830 tablet_bootstrap.cc:492] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5: Bootstrap starting.
I20260808 14:39:30.788955 7826 ts_tablet_manager.cc:1397] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:39:30.789597 7830 tablet_bootstrap.cc:654] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:30.789916 7830 log.cc:824] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:30.790771 7830 tablet_bootstrap.cc:492] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5: No bootstrap required, opened a new log
I20260808 14:39:30.790846 7830 ts_tablet_manager.cc:1397] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:39:30.790813 7827 raft_consensus.cc:348] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } }
I20260808 14:39:30.790992 7827 raft_consensus.cc:374] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:30.791038 7827 raft_consensus.cc:729] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8578bb0bfeb5476895deed26c6d366fa, State: Initialized, Role: FOLLOWER
I20260808 14:39:30.791167 7827 consensus_queue.cc:260] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } }
I20260808 14:39:30.791471 7827 ts_tablet_manager.cc:1428] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:39:30.791499 7657 heartbeater.cc:503] Master 127.20.81.62:38587 was elected leader, sending a full tablet report...
I20260808 14:39:30.791548 7826 raft_consensus.cc:348] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } }
I20260808 14:39:30.791729 7826 raft_consensus.cc:374] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:30.791770 7826 raft_consensus.cc:729] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af1def4dfec4e319dc2bb1cce31be77, State: Initialized, Role: FOLLOWER
I20260808 14:39:30.791888 7826 consensus_queue.cc:260] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } }
I20260808 14:39:30.792155 7826 ts_tablet_manager.cc:1428] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:39:30.792205 7809 heartbeater.cc:503] Master 127.20.81.62:38587 was elected leader, sending a full tablet report...
I20260808 14:39:30.793609 7830 raft_consensus.cc:348] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } }
I20260808 14:39:30.793726 7830 raft_consensus.cc:374] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:30.793747 7830 raft_consensus.cc:729] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56867db319b34dac836bf75774031eb5, State: Initialized, Role: FOLLOWER
I20260808 14:39:30.793851 7830 consensus_queue.cc:260] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } }
I20260808 14:39:30.794104 7830 ts_tablet_manager.cc:1428] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:39:30.794169 7511 heartbeater.cc:503] Master 127.20.81.62:38587 was elected leader, sending a full tablet report...
I20260808 14:39:30.809521 7832 raft_consensus.cc:482] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:30.809623 7832 raft_consensus.cc:504] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } }
I20260808 14:39:30.809928 7832 leader_election.cc:288] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9af1def4dfec4e319dc2bb1cce31be77 (127.20.81.3:40171), 56867db319b34dac836bf75774031eb5 (127.20.81.1:39687)
I20260808 14:39:30.813771 7822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.810201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:55877 (local address 127.20.81.3:40171)
0808 14:39:30.810259 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.810261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.810424 (+ 163us) server_negotiation.cc:407] Connection header received
0808 14:39:30.810454 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.810455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.810463 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.810501 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:30.810659 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.811354 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.812853 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.813404 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.813484 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.813493 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.813660 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.813703 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:39:30.813771 7824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.810187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:57159 (local address 127.20.81.1:39687)
0808 14:39:30.810232 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.810234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.810246 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:39:30.810279 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.810280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.810292 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.810353 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:30.810552 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.811326 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.812853 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.813404 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.813484 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.813493 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.813663 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.813703 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:39:30.813776 7659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.810103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:39687 (local address 127.20.81.2:57159)
0808 14:39:30.810168 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.810180 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.810224 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.810378 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.810379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.810381 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:30.810452 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.810454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.811425 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.811426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.812757 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.812760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.813493 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.813494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.813572 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.813573 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.813631 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.813680 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":38}
I20260808 14:39:30.813782 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.810103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:40171 (local address 127.20.81.2:55877)
0808 14:39:30.810302 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.810312 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:30.810387 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:30.810523 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:30.810524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:30.810526 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:30.810583 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.810584 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.811425 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.811426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.812757 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:30.812760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.813494 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.813495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:30.813570 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.813574 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:30.813631 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:39:30.813680 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":65,"thread_start_us":93,"threads_started":1}
I20260808 14:39:30.814119 7756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11495e00cbb44a5f9aa1ed3a06565cf6" candidate_uuid: "8578bb0bfeb5476895deed26c6d366fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af1def4dfec4e319dc2bb1cce31be77" is_pre_election: true
I20260808 14:39:30.814123 7461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11495e00cbb44a5f9aa1ed3a06565cf6" candidate_uuid: "8578bb0bfeb5476895deed26c6d366fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56867db319b34dac836bf75774031eb5" is_pre_election: true
I20260808 14:39:30.814270 7461 raft_consensus.cc:2454] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8578bb0bfeb5476895deed26c6d366fa in term 0.
I20260808 14:39:30.814270 7756 raft_consensus.cc:2454] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8578bb0bfeb5476895deed26c6d366fa in term 0.
I20260808 14:39:30.814493 7531 leader_election.cc:302] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8578bb0bfeb5476895deed26c6d366fa, 9af1def4dfec4e319dc2bb1cce31be77; no voters:
I20260808 14:39:30.814625 7832 raft_consensus.cc:2781] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:39:30.814679 7832 raft_consensus.cc:482] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:39:30.814738 7832 raft_consensus.cc:3037] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:30.815429 7832 raft_consensus.cc:504] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } }
I20260808 14:39:30.815579 7832 leader_election.cc:288] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [CANDIDATE]: Term 1 election: Requested vote from peers 9af1def4dfec4e319dc2bb1cce31be77 (127.20.81.3:40171), 56867db319b34dac836bf75774031eb5 (127.20.81.1:39687)
I20260808 14:39:30.815752 7756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11495e00cbb44a5f9aa1ed3a06565cf6" candidate_uuid: "8578bb0bfeb5476895deed26c6d366fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af1def4dfec4e319dc2bb1cce31be77"
I20260808 14:39:30.815771 7461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11495e00cbb44a5f9aa1ed3a06565cf6" candidate_uuid: "8578bb0bfeb5476895deed26c6d366fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56867db319b34dac836bf75774031eb5"
I20260808 14:39:30.815833 7756 raft_consensus.cc:3037] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:30.815833 7461 raft_consensus.cc:3037] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:30.816730 7756 raft_consensus.cc:2454] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8578bb0bfeb5476895deed26c6d366fa in term 1.
I20260808 14:39:30.816730 7461 raft_consensus.cc:2454] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8578bb0bfeb5476895deed26c6d366fa in term 1.
I20260808 14:39:30.816919 7529 leader_election.cc:302] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56867db319b34dac836bf75774031eb5, 8578bb0bfeb5476895deed26c6d366fa; no voters:
I20260808 14:39:30.817022 7832 raft_consensus.cc:2781] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:30.817181 7832 raft_consensus.cc:686] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 1 LEADER]: Becoming Leader. State: Replica: 8578bb0bfeb5476895deed26c6d366fa, State: Running, Role: LEADER
I20260808 14:39:30.817281 7832 consensus_queue.cc:237] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } }
I20260808 14:39:30.818161 7294 catalog_manager.cc:5495] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 8578bb0bfeb5476895deed26c6d366fa (127.20.81.2). New cstate: current_term: 1 leader_uuid: "8578bb0bfeb5476895deed26c6d366fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8578bb0bfeb5476895deed26c6d366fa" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 36567 } health_report { overall_health: HEALTHY } } }
I20260808 14:39:30.826072 7825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.823851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57782 (local address 127.20.81.2:36567)
0808 14:39:30.823899 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:30.823901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:30.823910 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:30.823967 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:30.823968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:30.823983 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:30.824044 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:39:30.824151 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.824662 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.825373 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:30.825556 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:30.825609 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:30.825736 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:39:30.825832 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:39:30.825894 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:30.825915 (+ 21us) server_negotiation.cc:299] Negotiation successful
0808 14:39:30.825937 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:39:30.827832 7461 raft_consensus.cc:1261] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 56867db319b34dac836bf75774031eb5 [term 1 FOLLOWER]: Refusing update from remote peer 8578bb0bfeb5476895deed26c6d366fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:30.827852 7756 raft_consensus.cc:1261] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [term 1 FOLLOWER]: Refusing update from remote peer 8578bb0bfeb5476895deed26c6d366fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:30.828167 7837 consensus_queue.cc:1035] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "56867db319b34dac836bf75774031eb5" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:30.828277 7832 consensus_queue.cc:1035] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9af1def4dfec4e319dc2bb1cce31be77" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:30.830856 7842 mvcc.cc:205] Tried to move back new op lower bound from 7316275080508137472 to 7316275080468447232. Current Snapshot: MvccSnapshot[applied={T|T < 7316275080508137472}]
I20260808 14:39:30.831130 7841 mvcc.cc:205] Tried to move back new op lower bound from 7316275080508137472 to 7316275080468447232. Current Snapshot: MvccSnapshot[applied={T|T < 7316275080508137472}]
I20260808 14:39:30.831262 7840 mvcc.cc:205] Tried to move back new op lower bound from 7316275080508137472 to 7316275080468447232. Current Snapshot: MvccSnapshot[applied={T|T < 7316275080508137472}]
I20260808 14:39:30.833365 7294 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:30.833458 7294 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:30.834231 7294 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fb7d25c5f2e4c14968091132f6b08c8: Sending DeleteTablet for 3 replicas of tablet 11495e00cbb44a5f9aa1ed3a06565cf6
I20260808 14:39:30.834595 7580 tablet_service.cc:1514] Processing DeleteTablet for tablet 11495e00cbb44a5f9aa1ed3a06565cf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:30 UTC) from {username='slave'} at 127.0.0.1:57772
I20260808 14:39:30.834636 7436 tablet_service.cc:1514] Processing DeleteTablet for tablet 11495e00cbb44a5f9aa1ed3a06565cf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:30 UTC) from {username='slave'} at 127.0.0.1:39564
I20260808 14:39:30.834681 7728 tablet_service.cc:1514] Processing DeleteTablet for tablet 11495e00cbb44a5f9aa1ed3a06565cf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:30 UTC) from {username='slave'} at 127.0.0.1:46180
I20260808 14:39:30.834888 7853 tablet_replica.cc:330] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: stopping tablet replica
I20260808 14:39:30.835001 7853 raft_consensus.cc:2229] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:30.835110 7853 raft_consensus.cc:2258] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:30.835115 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 7364
I20260808 14:39:30.836428 7853 ts_tablet_manager.cc:1905] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:30.838492 7853 ts_tablet_manager.cc:1918] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:30.838586 7853 log.cc:1196] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/11495e00cbb44a5f9aa1ed3a06565cf6
I20260808 14:39:30.838897 7853 ts_tablet_manager.cc:1939] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 9af1def4dfec4e319dc2bb1cce31be77: Deleting consensus metadata
I20260808 14:39:30.839413 7277 catalog_manager.cc:4841] TS 9af1def4dfec4e319dc2bb1cce31be77 (127.20.81.3:40171): tablet 11495e00cbb44a5f9aa1ed3a06565cf6 (table test-table [id=d767de6b7c0e47fe9055e6e40fd0f0f5]) successfully deleted
I20260808 14:39:30.841157 7851 tablet_replica.cc:330] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: stopping tablet replica
I20260808 14:39:30.841292 7851 raft_consensus.cc:2229] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:39:30.841437 7851 raft_consensus.cc:2258] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:30.841907 7851 ts_tablet_manager.cc:1905] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:30.843784 7851 ts_tablet_manager.cc:1918] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:30.843865 7851 log.cc:1196] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/11495e00cbb44a5f9aa1ed3a06565cf6
I20260808 14:39:30.844158 7851 ts_tablet_manager.cc:1939] T 11495e00cbb44a5f9aa1ed3a06565cf6 P 8578bb0bfeb5476895deed26c6d366fa: Deleting consensus metadata
I20260808 14:39:30.844619 7275 catalog_manager.cc:4841] TS 8578bb0bfeb5476895deed26c6d366fa (127.20.81.2:36567): tablet 11495e00cbb44a5f9aa1ed3a06565cf6 (table test-table [id=d767de6b7c0e47fe9055e6e40fd0f0f5]) successfully deleted
W20260808 14:39:30.845906 7275 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:39687 (error 108)
I20260808 14:39:30.846122 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 7514
I20260808 14:39:30.847388 7823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:30.847254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:39687 (local address 127.0.0.1:39580)
0808 14:39:30.847306 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:30.847345 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:39687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:39:30.847543 7275 catalog_manager.cc:4584] TS 56867db319b34dac836bf75774031eb5 (127.20.81.1:39687): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 11495e00cbb44a5f9aa1ed3a06565cf6: Network error: Client connection negotiation failed: client connection to 127.20.81.1:39687: connect: Connection refused (error 111)
I20260808 14:39:30.854254 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 7660
I20260808 14:39:30.860877 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 7257
2026-08-08T14:39:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (705 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:30 dist-test-slave-8n49 krb5kdc[7857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:30 dist-test-slave-8n49 krb5kdc[7857](info): set up 2 sockets
Aug 08 14:39:30 dist-test-slave-8n49 krb5kdc[7857](info): commencing operation
krb5kdc: starting...
W20260808 14:39:31.940668 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:32 dist-test-slave-8n49 krb5kdc[7857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:39:32.061446 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35017
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:39407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:35017
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:32.144245 7870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:32.144496 7870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:32.144536 7870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:32.145711 7870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:32.145781 7870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:32.145808 7870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:32.145839 7870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:32.145864 7870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:32.147367 7870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:39407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:35017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:35017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:32.147653 7870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:32.147886 7870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:32.152904 7877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:32.152936 7876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:32.152936 7879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:32.153040 7870 server_base.cc:1034] running on GCE node
I20260808 14:39:32.153345 7870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:32.153664 7870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:32.154834 7870 hybrid_clock.cc:648] HybridClock initialized: now 1786199972154822 us; error 47 us; skew 500 ppm
Aug 08 14:39:32 dist-test-slave-8n49 krb5kdc[7857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199972, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:32.157478 7870 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:39:32.157974 7870 webserver.cc:460] Webserver started at http://127.20.81.62:45347/ using document root <none> and password file <none>
I20260808 14:39:32.158227 7870 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:32.158298 7870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:32.158452 7870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:32.159512 7870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "3e50a3b89972437694fd53face1d7edd"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "73e55af3cf1031effa3020aef5c7a303"
server_key_iv: "f3be594460f827118288e6be6252d0a9"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.159885 7870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "3e50a3b89972437694fd53face1d7edd"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "73e55af3cf1031effa3020aef5c7a303"
server_key_iv: "f3be594460f827118288e6be6252d0a9"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.161332 7870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:39:32.162066 7886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.162240 7870 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.162346 7870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "3e50a3b89972437694fd53face1d7edd"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "73e55af3cf1031effa3020aef5c7a303"
server_key_iv: "f3be594460f827118288e6be6252d0a9"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.162427 7870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:32.186868 7870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:32.189345 7870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:32.189517 7870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:32.194047 7870 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:35017
I20260808 14:39:32.194088 7945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:35017 every 8 connection(s)
I20260808 14:39:32.194468 7870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:32.195360 7946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:32.196591 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 7870
I20260808 14:39:32.196725 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:32.196946 20804 external_mini_cluster.cc:1428] Setting key 59cf70d9e53a1bc5d01a0a84dfed8929
I20260808 14:39:32.198257 7946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd: Bootstrap starting.
I20260808 14:39:32.199020 7946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:32.199373 7946 log.cc:824] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:32.200165 7946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd: No bootstrap required, opened a new log
I20260808 14:39:32.202447 7946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e50a3b89972437694fd53face1d7edd" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35017 } }
I20260808 14:39:32.202607 7946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:32.202654 7946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e50a3b89972437694fd53face1d7edd, State: Initialized, Role: FOLLOWER
I20260808 14:39:32.202839 7946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e50a3b89972437694fd53face1d7edd" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35017 } }
I20260808 14:39:32.202947 7946 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:32.202982 7946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:32.203037 7946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:32.203809 7946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e50a3b89972437694fd53face1d7edd" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35017 } }
I20260808 14:39:32.203928 7946 leader_election.cc:302] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e50a3b89972437694fd53face1d7edd; no voters:
I20260808 14:39:32.204106 7946 leader_election.cc:288] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:32.204139 7951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:32.204288 7951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [term 1 LEADER]: Becoming Leader. State: Replica: 3e50a3b89972437694fd53face1d7edd, State: Running, Role: LEADER
I20260808 14:39:32.204382 7946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:32.204449 7951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e50a3b89972437694fd53face1d7edd" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35017 } }
Aug 08 14:39:32 dist-test-slave-8n49 krb5kdc[7857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:32.206076 7954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e50a3b89972437694fd53face1d7edd. Latest consensus state: current_term: 1 leader_uuid: "3e50a3b89972437694fd53face1d7edd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e50a3b89972437694fd53face1d7edd" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35017 } } }
W20260808 14:39:32.206406 7970 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 14:39:32.206609 7954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [sys.catalog]: This master's current role is: LEADER
W20260808 14:39:32.206633 7970 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:39:32.206072 7952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e50a3b89972437694fd53face1d7edd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e50a3b89972437694fd53face1d7edd" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 35017 } } }
I20260808 14:39:32.206772 7952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:32.206905 7972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:32.207084 7972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:32.208788 7972 catalog_manager.cc:1347] Generated new cluster ID: 6a8fd52bcc8747ee9d0393faa8c396d2
I20260808 14:39:32.208843 7972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:32.213043 7949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.197490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54708 (local address 127.20.81.62:35017)
0808 14:39:32.197689 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.197697 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.197723 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:39:32.198162 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.198169 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.198217 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.198365 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:32.199233 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.200642 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.201417 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.202109 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.202245 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.205200 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:32.205204 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:32.205204 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:32.205217 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:32.207405 (+ 2188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.207794 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.207797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.207798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.207913 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.208159 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.208160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.208160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.208493 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:32.208663 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.212706 (+ 4043us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.212847 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
I20260808 14:39:32.215397 7972 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:32.216106 7972 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:32.219360 7972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd: Generated new TSK 0
I20260808 14:39:32.219521 7972 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:39:32.247278 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35017
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:39407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:32.331882 7977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:32.332149 7977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:32.332175 7977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:32.333407 7977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:32.333454 7977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:32.333482 7977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:39:32.334899 7977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:39407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:32.335119 7977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:32.335299 7977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:32.340446 7982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:32.340456 7983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:32.340456 7986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:32.340692 7977 server_base.cc:1034] running on GCE node
I20260808 14:39:32.340977 7977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:32.341238 7977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:32.342413 7977 hybrid_clock.cc:648] HybridClock initialized: now 1786199972342397 us; error 28 us; skew 500 ppm
Aug 08 14:39:32 dist-test-slave-8n49 krb5kdc[7857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199972, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:32.345218 7977 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:39:32.345695 7977 webserver.cc:460] Webserver started at http://127.20.81.1:32939/ using document root <none> and password file <none>
I20260808 14:39:32.345937 7977 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:32.346017 7977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:32.346289 7977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:32.347409 7977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "d63896e6c9d8e263d1770892eaf51378"
server_key_iv: "4f95b56984d25caea88271edee6ac567"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.347807 7977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "d63896e6c9d8e263d1770892eaf51378"
server_key_iv: "4f95b56984d25caea88271edee6ac567"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.349357 7977 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:32.350147 7994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.350334 7977 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:32.350443 7977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "d63896e6c9d8e263d1770892eaf51378"
server_key_iv: "4f95b56984d25caea88271edee6ac567"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.350523 7977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:32.376897 7977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:32.379365 7977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:32.379546 7977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:32.379815 7977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:32.380146 7977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:32.380201 7977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.380246 7977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:32.380276 7977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.386466 7977 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:45817
I20260808 14:39:32.386518 8119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:45817 every 8 connection(s)
I20260808 14:39:32.386857 7977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:39:32 dist-test-slave-8n49 krb5kdc[7857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199972, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:32.393033 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 7977
I20260808 14:39:32.393165 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:39:32.393411 20804 external_mini_cluster.cc:1428] Setting key fc12bccce3f2c849fb5d22b8c0df3952
I20260808 14:39:32.396922 7949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.387628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:35385 (local address 127.20.81.62:35017)
0808 14:39:32.387677 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.387679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.387901 (+ 222us) server_negotiation.cc:407] Connection header received
0808 14:39:32.388375 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.388376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.388386 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.388440 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:32.389468 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.389972 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.390961 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.391167 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.391220 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.393561 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:32.393562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:32.393562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:32.393570 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:32.395364 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.395757 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.395758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.395759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.395824 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.396178 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.396179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.396179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.396305 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:32.396379 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.396738 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.396827 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:39:32.397145 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.387592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35017 (local address 127.20.81.1:35385)
0808 14:39:32.387764 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:32.387803 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:32.388285 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:32.388501 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:32.388505 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:32.389161 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:32.389359 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.389364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.390060 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.390061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.390880 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.390882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.391244 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.391245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.391346 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.391846 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:32.391857 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:32.393449 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:32.395450 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:32.395463 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:32.395465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:32.395682 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:32.395917 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:32.395918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:32.395919 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:32.396084 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:32.396382 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:32.396391 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:32.396536 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 14:39:32.396715 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 14:39:32.396884 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":101,"threads_started":1}
I20260808 14:39:32.397679 8120 heartbeater.cc:347] Connected to a master server at 127.20.81.62:35017
I20260808 14:39:32.397778 8120 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:32.397984 8120 heartbeater.cc:511] Master 127.20.81.62:35017 requested a full tablet report, sending...
I20260808 14:39:32.398527 7907 ts_manager.cc:194] Registered new tserver with Master: 5d0f6ba3d7d84414b6f6e57223cc5b0d (127.20.81.1:45817)
I20260808 14:39:32.399156 7907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:35385
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:39:32.421813 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35017
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:39407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:32.507052 8125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:32.507256 8125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:32.507279 8125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:32.508460 8125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:32.508508 8125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:32.508535 8125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:39:32.510098 8125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:39407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:32.510355 8125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:32.510599 8125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:32.515700 8134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:32.515733 8132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:32.515725 8131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:32.515957 8125 server_base.cc:1034] running on GCE node
I20260808 14:39:32.516177 8125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:32.516474 8125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:32.517619 8125 hybrid_clock.cc:648] HybridClock initialized: now 1786199972517592 us; error 42 us; skew 500 ppm
Aug 08 14:39:32 dist-test-slave-8n49 krb5kdc[7857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199972, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:32.520118 8125 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:39:32.520680 8125 webserver.cc:460] Webserver started at http://127.20.81.2:37967/ using document root <none> and password file <none>
I20260808 14:39:32.520949 8125 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:32.521019 8125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:32.521186 8125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:32.522285 8125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "edf62f887e3449a9b6232b7f0aef380b"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "911f8734ccd8dff9e71958297bf57dd9"
server_key_iv: "1c090a62e417feeb9c7da503a1edb982"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.522692 8125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "edf62f887e3449a9b6232b7f0aef380b"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "911f8734ccd8dff9e71958297bf57dd9"
server_key_iv: "1c090a62e417feeb9c7da503a1edb982"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.524063 8125 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:32.524857 8141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.525036 8125 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:32.525131 8125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "edf62f887e3449a9b6232b7f0aef380b"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "911f8734ccd8dff9e71958297bf57dd9"
server_key_iv: "1c090a62e417feeb9c7da503a1edb982"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.525218 8125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:32.536863 8125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:32.538806 8125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:32.538973 8125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:32.539227 8125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:32.539553 8125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:32.539609 8125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.539681 8125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:32.539713 8125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.545771 8125 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:42355
I20260808 14:39:32.545817 8263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:42355 every 8 connection(s)
I20260808 14:39:32.546160 8125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:39:32.547581 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 8125
I20260808 14:39:32.547725 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:39:32.547966 20804 external_mini_cluster.cc:1428] Setting key bb35ad1ee6f2f5d3cd33720351df57f3
Aug 08 14:39:32 dist-test-slave-8n49 krb5kdc[7857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199972, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:32.557091 7949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.546890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:48819 (local address 127.20.81.62:35017)
0808 14:39:32.546941 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.546943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.547181 (+ 238us) server_negotiation.cc:407] Connection header received
0808 14:39:32.547703 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.547705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.547721 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.547803 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:32.549065 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.549819 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.551211 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.551400 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.551460 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.554107 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:32.554109 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:32.554111 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:32.554125 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:32.555606 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.556041 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.556043 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.556043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.556109 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.556378 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.556379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.556380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.556506 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:32.556609 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.556904 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.556994 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:39:32.557300 8266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.546859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35017 (local address 127.20.81.2:48819)
0808 14:39:32.547032 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:32.547086 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:32.547582 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:32.547898 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:32.547902 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:32.548733 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:32.548974 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.548979 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.549929 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.549930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.551117 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.551120 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.551489 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.551490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.551652 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.552181 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:32.552192 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:32.553974 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:32.555712 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:32.555720 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:32.555723 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:32.555959 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:32.556183 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:32.556184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:32.556185 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:32.556306 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:32.556594 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:32.556602 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:32.556763 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 14:39:32.556880 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 14:39:32.557053 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
I20260808 14:39:32.558009 8264 heartbeater.cc:347] Connected to a master server at 127.20.81.62:35017
I20260808 14:39:32.558120 8264 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:32.558332 8264 heartbeater.cc:511] Master 127.20.81.62:35017 requested a full tablet report, sending...
I20260808 14:39:32.558722 7907 ts_manager.cc:194] Registered new tserver with Master: edf62f887e3449a9b6232b7f0aef380b (127.20.81.2:42355)
I20260808 14:39:32.559175 7907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:48819
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:39:32.575812 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35017
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:39407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:32.661381 8270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:32.661603 8270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:32.661628 8270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:32.662827 8270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:32.662868 8270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:32.662894 8270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:39:32.664366 8270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:39407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:35017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:32.664654 8270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:32.664908 8270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:32.669994 8279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:32.669967 8276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:32.670349 8270 server_base.cc:1034] running on GCE node
W20260808 14:39:32.669989 8277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:32.670625 8270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:32.670903 8270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:32.672052 8270 hybrid_clock.cc:648] HybridClock initialized: now 1786199972672034 us; error 42 us; skew 500 ppm
Aug 08 14:39:32 dist-test-slave-8n49 krb5kdc[7857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199972, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:32.674926 8270 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:39:32.675330 8270 webserver.cc:460] Webserver started at http://127.20.81.3:44321/ using document root <none> and password file <none>
I20260808 14:39:32.675578 8270 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:32.675652 8270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:32.675813 8270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:32.676985 8270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "32e3ade504924757ad8f98b74e6b801d"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "3501ae2619d97db62dbd174d11a0b046"
server_key_iv: "46823f018efa66a2f28e94fcfb0dafa8"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.677362 8270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "32e3ade504924757ad8f98b74e6b801d"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "3501ae2619d97db62dbd174d11a0b046"
server_key_iv: "46823f018efa66a2f28e94fcfb0dafa8"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.678747 8270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:39:32.679519 8289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.679725 8270 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:32.679836 8270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "32e3ade504924757ad8f98b74e6b801d"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "3501ae2619d97db62dbd174d11a0b046"
server_key_iv: "46823f018efa66a2f28e94fcfb0dafa8"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.679912 8270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:32.691840 8270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:32.694412 8270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:32.694600 8270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:32.694873 8270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:32.695219 8270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:32.695279 8270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.695322 8270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:32.695366 8270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.701408 8270 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:36815
I20260808 14:39:32.701498 8412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:36815 every 8 connection(s)
I20260808 14:39:32.701843 8270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:39:32 dist-test-slave-8n49 krb5kdc[7857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199972, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:32.711675 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 8270
I20260808 14:39:32.711797 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:39:32.712013 20804 external_mini_cluster.cc:1428] Setting key 1f2b840c33f3579c07973d673b8a9a6c
I20260808 14:39:32.712194 7949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.702636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:53591 (local address 127.20.81.62:35017)
0808 14:39:32.702720 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.702722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.702904 (+ 182us) server_negotiation.cc:407] Connection header received
0808 14:39:32.703405 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.703407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.703419 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.703488 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:32.704669 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.705230 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.706402 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.706608 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.706669 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.708968 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:32.708970 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:32.708970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:32.708978 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:32.710364 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.710863 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.710864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.710864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.710924 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.711262 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.711263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.711263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.711394 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:32.711470 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.711983 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.712095 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:39:32.712482 8415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.702606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:35017 (local address 127.20.81.3:53591)
0808 14:39:32.702765 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:32.702808 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:32.703308 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:32.703544 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:32.703547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:32.704266 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:32.704483 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.704488 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.705312 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.705314 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.706326 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.706329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.706712 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.706714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.706849 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.707379 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:32.707388 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:32.708857 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:32.710460 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:32.710466 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:32.710469 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:32.710722 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:32.711023 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:32.711024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:32.711024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:32.711153 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:32.711579 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:32.711587 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:32.711795 (+ 208us) client_negotiation.cc:769] Sending connection context
0808 14:39:32.711932 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 14:39:32.712122 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260808 14:39:32.713061 8413 heartbeater.cc:347] Connected to a master server at 127.20.81.62:35017
I20260808 14:39:32.713174 8413 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:32.713403 8413 heartbeater.cc:511] Master 127.20.81.62:35017 requested a full tablet report, sending...
I20260808 14:39:32.713856 7907 ts_manager.cc:194] Registered new tserver with Master: 32e3ade504924757ad8f98b74e6b801d (127.20.81.3:36815)
I20260808 14:39:32.714355 7907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:53591
I20260808 14:39:32.724714 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:39:32.733491 7949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.726274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54712 (local address 127.20.81.62:35017)
0808 14:39:32.726359 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.726362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.726462 (+ 100us) server_negotiation.cc:407] Connection header received
0808 14:39:32.726663 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.726665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.726677 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.726739 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:32.727326 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.727845 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.728666 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.728873 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.728954 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.730428 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:32.730430 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:32.730430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:32.730438 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:32.732080 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.732512 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.732514 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.732514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.732660 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:32.732890 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:32.732891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:32.732891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:32.733045 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:32.733169 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.733312 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.733383 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:39:32.735826 7907 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:39:32.737941 7907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:39:32.745827 8425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.740480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:36815 (local address 127.0.0.1:42626)
0808 14:39:32.741224 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:32.741235 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:32.741293 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:32.741595 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:32.741595 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:32.741597 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:32.741644 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.741645 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.742931 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.742932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.744636 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.744639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.745465 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.745466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.745551 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.745568 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 14:39:32.745669 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:39:32.745736 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":72,"thread_start_us":122,"threads_started":1}
I20260808 14:39:32.745997 8430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.740501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:45817 (local address 127.0.0.1:40942)
0808 14:39:32.741466 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:32.741475 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:32.741518 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:32.742905 (+ 1387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:32.742906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:32.742909 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:32.742948 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.742949 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.744059 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.744060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.744943 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.744946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.745766 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.745767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.745824 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.745827 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:32.745876 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:39:32.745921 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":943,"thread_start_us":665,"threads_started":1}
I20260808 14:39:32.746289 8429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.740977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40942 (local address 127.20.81.1:45817)
0808 14:39:32.741180 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.741185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.741575 (+ 390us) server_negotiation.cc:407] Connection header received
0808 14:39:32.741631 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.741633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.741648 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.741724 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:32.743041 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.743943 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.745048 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.745614 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.745677 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.745730 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.746117 (+ 387us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.746166 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260808 14:39:32.746459 8427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.740728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42626 (local address 127.20.81.3:36815)
0808 14:39:32.740917 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.740923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.741357 (+ 434us) server_negotiation.cc:407] Connection header received
0808 14:39:32.741405 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.741407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.741425 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.741505 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:32.741727 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.742791 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.744735 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.745372 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.745433 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.745476 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.746315 (+ 839us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.746365 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":91,"threads_started":1}
I20260808 14:39:32.747005 8045 tablet_service.cc:1467] Processing CreateTablet for tablet 380ec29e9af448bc9d3f98189c08e7e1 (DEFAULT_TABLE table=test-table [id=ca9c2b7faa9f4dd8881bd8d6195dd6ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:32.747059 8339 tablet_service.cc:1467] Processing CreateTablet for tablet 380ec29e9af448bc9d3f98189c08e7e1 (DEFAULT_TABLE table=test-table [id=ca9c2b7faa9f4dd8881bd8d6195dd6ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:32.747385 8339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 380ec29e9af448bc9d3f98189c08e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:32.747385 8045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 380ec29e9af448bc9d3f98189c08e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:32.750370 8432 tablet_bootstrap.cc:492] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d: Bootstrap starting.
I20260808 14:39:32.750473 8433 tablet_bootstrap.cc:492] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: Bootstrap starting.
I20260808 14:39:32.751066 8426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.740480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:42355 (local address 127.0.0.1:46402)
0808 14:39:32.740674 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:32.740719 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:32.740787 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:32.741214 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:32.741218 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:32.741220 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:32.741349 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.741351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.742822 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.742824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.744635 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.744639 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.750757 (+ 6118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.750759 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.750852 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.750859 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:39:32.750932 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:39:32.750986 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":100,"thread_start_us":49,"threads_started":1}
I20260808 14:39:32.751104 8428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.740749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46402 (local address 127.20.81.2:42355)
0808 14:39:32.741005 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.741010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.741022 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:39:32.741068 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.741071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.741088 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.741201 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:32.741451 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.742634 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.745511 (+ 2877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.746343 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.750724 (+ 4381us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.750825 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.750963 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.751020 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":100,"threads_started":1}
I20260808 14:39:32.751255 8433 tablet_bootstrap.cc:654] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:32.751592 8432 tablet_bootstrap.cc:654] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:32.751863 8433 log.cc:824] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:32.751940 8191 tablet_service.cc:1467] Processing CreateTablet for tablet 380ec29e9af448bc9d3f98189c08e7e1 (DEFAULT_TABLE table=test-table [id=ca9c2b7faa9f4dd8881bd8d6195dd6ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:32.752179 8432 log.cc:824] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:32.752321 8191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 380ec29e9af448bc9d3f98189c08e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:32.752874 8433 tablet_bootstrap.cc:492] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: No bootstrap required, opened a new log
I20260808 14:39:32.753019 8433 ts_tablet_manager.cc:1397] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:39:32.754988 8433 raft_consensus.cc:348] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } }
I20260808 14:39:32.755297 8433 raft_consensus.cc:374] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:32.755349 8433 raft_consensus.cc:729] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32e3ade504924757ad8f98b74e6b801d, State: Initialized, Role: FOLLOWER
I20260808 14:39:32.755354 8436 tablet_bootstrap.cc:492] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: Bootstrap starting.
I20260808 14:39:32.755565 8433 consensus_queue.cc:260] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } }
I20260808 14:39:32.756074 8436 tablet_bootstrap.cc:654] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:32.756058 8413 heartbeater.cc:503] Master 127.20.81.62:35017 was elected leader, sending a full tablet report...
I20260808 14:39:32.756074 8433 ts_tablet_manager.cc:1428] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:39:32.756436 8432 tablet_bootstrap.cc:492] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d: No bootstrap required, opened a new log
I20260808 14:39:32.756520 8432 ts_tablet_manager.cc:1397] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 14:39:32.756735 8436 log.cc:824] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:32.757647 8436 tablet_bootstrap.cc:492] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: No bootstrap required, opened a new log
I20260808 14:39:32.757720 8436 ts_tablet_manager.cc:1397] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:39:32.758488 8432 raft_consensus.cc:348] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } }
I20260808 14:39:32.758685 8432 raft_consensus.cc:374] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:32.758735 8432 raft_consensus.cc:729] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f6ba3d7d84414b6f6e57223cc5b0d, State: Initialized, Role: FOLLOWER
I20260808 14:39:32.758867 8432 consensus_queue.cc:260] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } }
I20260808 14:39:32.759218 8432 ts_tablet_manager.cc:1428] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260808 14:39:32.759246 8120 heartbeater.cc:503] Master 127.20.81.62:35017 was elected leader, sending a full tablet report...
I20260808 14:39:32.759310 8436 raft_consensus.cc:348] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } }
I20260808 14:39:32.759485 8436 raft_consensus.cc:374] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:32.759519 8436 raft_consensus.cc:729] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf62f887e3449a9b6232b7f0aef380b, State: Initialized, Role: FOLLOWER
I20260808 14:39:32.759629 8436 consensus_queue.cc:260] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } }
I20260808 14:39:32.759909 8264 heartbeater.cc:503] Master 127.20.81.62:35017 was elected leader, sending a full tablet report...
I20260808 14:39:32.760195 8436 ts_tablet_manager.cc:1428] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:39:32.782213 8440 raft_consensus.cc:482] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:32.782346 8440 raft_consensus.cc:504] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } }
I20260808 14:39:32.782896 8440 leader_election.cc:288] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32e3ade504924757ad8f98b74e6b801d (127.20.81.3:36815), edf62f887e3449a9b6232b7f0aef380b (127.20.81.2:42355)
I20260808 14:39:32.786669 8428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.783156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:58975 (local address 127.20.81.2:42355)
0808 14:39:32.783220 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.783222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.783590 (+ 368us) server_negotiation.cc:407] Connection header received
0808 14:39:32.783660 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.783661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.783676 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.783764 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:32.783920 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.784363 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.785656 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.786250 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.786328 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.786339 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.786571 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.786608 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:39:32.786666 8427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.783148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:39337 (local address 127.20.81.3:36815)
0808 14:39:32.783221 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.783223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.783235 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:39:32.783305 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.783306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.783316 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.783359 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:32.783594 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.784193 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.785645 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.786249 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.786328 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.786338 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.786555 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.786596 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:39:32.786713 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.783105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:36815 (local address 127.20.81.1:39337)
0808 14:39:32.783160 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:32.783174 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:32.783229 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:32.783392 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:32.783393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:32.783395 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:32.783510 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.783529 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.784272 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.784273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.785525 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.785528 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.786365 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.786366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.786475 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.786478 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:32.786535 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:39:32.786592 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":8}
I20260808 14:39:32.786720 8443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.783110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:42355 (local address 127.20.81.1:58975)
0808 14:39:32.783491 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:32.783517 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:32.783604 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:32.783790 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:32.783791 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:32.783793 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:32.783861 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.783863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.784438 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.784439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.785572 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:32.785574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.786365 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.786366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:32.786457 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.786462 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:39:32.786535 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:39:32.786592 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":144,"thread_start_us":162,"threads_started":1}
I20260808 14:39:32.787129 8363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "380ec29e9af448bc9d3f98189c08e7e1" candidate_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32e3ade504924757ad8f98b74e6b801d" is_pre_election: true
I20260808 14:39:32.787165 8212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "380ec29e9af448bc9d3f98189c08e7e1" candidate_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf62f887e3449a9b6232b7f0aef380b" is_pre_election: true
I20260808 14:39:32.787305 8363 raft_consensus.cc:2454] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f6ba3d7d84414b6f6e57223cc5b0d in term 0.
I20260808 14:39:32.787354 8212 raft_consensus.cc:2454] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f6ba3d7d84414b6f6e57223cc5b0d in term 0.
I20260808 14:39:32.787575 7995 leader_election.cc:302] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32e3ade504924757ad8f98b74e6b801d, 5d0f6ba3d7d84414b6f6e57223cc5b0d; no voters:
I20260808 14:39:32.787716 8440 raft_consensus.cc:2781] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:39:32.787776 8440 raft_consensus.cc:482] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:39:32.787801 8440 raft_consensus.cc:3037] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:32.788542 8440 raft_consensus.cc:504] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } }
I20260808 14:39:32.788771 8440 leader_election.cc:288] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [CANDIDATE]: Term 1 election: Requested vote from peers 32e3ade504924757ad8f98b74e6b801d (127.20.81.3:36815), edf62f887e3449a9b6232b7f0aef380b (127.20.81.2:42355)
I20260808 14:39:32.788928 8363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "380ec29e9af448bc9d3f98189c08e7e1" candidate_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32e3ade504924757ad8f98b74e6b801d"
I20260808 14:39:32.788928 8212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "380ec29e9af448bc9d3f98189c08e7e1" candidate_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf62f887e3449a9b6232b7f0aef380b"
I20260808 14:39:32.789011 8212 raft_consensus.cc:3037] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:32.789026 8363 raft_consensus.cc:3037] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:32.789737 8363 raft_consensus.cc:2454] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f6ba3d7d84414b6f6e57223cc5b0d in term 1.
I20260808 14:39:32.789793 8212 raft_consensus.cc:2454] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f6ba3d7d84414b6f6e57223cc5b0d in term 1.
I20260808 14:39:32.789965 7995 leader_election.cc:302] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32e3ade504924757ad8f98b74e6b801d, 5d0f6ba3d7d84414b6f6e57223cc5b0d; no voters:
I20260808 14:39:32.790073 8440 raft_consensus.cc:2781] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:32.790275 8440 raft_consensus.cc:686] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f6ba3d7d84414b6f6e57223cc5b0d, State: Running, Role: LEADER
I20260808 14:39:32.790393 8440 consensus_queue.cc:237] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } }
I20260808 14:39:32.791311 7907 catalog_manager.cc:5495] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f6ba3d7d84414b6f6e57223cc5b0d (127.20.81.1). New cstate: current_term: 1 leader_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f6ba3d7d84414b6f6e57223cc5b0d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45817 } health_report { overall_health: HEALTHY } } }
W20260808 14:39:32.796675 8265 tablet.cc:2369] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:39:32.804183 8429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.801694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40944 (local address 127.20.81.1:45817)
0808 14:39:32.801760 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:32.801762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:32.801773 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:39:32.801847 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:32.801850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:32.801875 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:32.801954 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:39:32.802110 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.802585 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.803355 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:32.803580 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:32.803661 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:32.803834 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:39:32.803924 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:39:32.804039 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:32.804070 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 14:39:32.804079 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:39:32.806273 8212 raft_consensus.cc:1261] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [term 1 FOLLOWER]: Refusing update from remote peer 5d0f6ba3d7d84414b6f6e57223cc5b0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:32.806592 8363 raft_consensus.cc:1261] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [term 1 FOLLOWER]: Refusing update from remote peer 5d0f6ba3d7d84414b6f6e57223cc5b0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:32.806675 8444 consensus_queue.cc:1035] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf62f887e3449a9b6232b7f0aef380b" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 42355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:32.806876 8444 consensus_queue.cc:1035] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32e3ade504924757ad8f98b74e6b801d" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:32.809484 8450 mvcc.cc:205] Tried to move back new op lower bound from 7316275088611618816 to 7316275088550068224. Current Snapshot: MvccSnapshot[applied={T|T < 7316275088611618816}]
I20260808 14:39:32.809764 8451 mvcc.cc:205] Tried to move back new op lower bound from 7316275088611618816 to 7316275088550068224. Current Snapshot: MvccSnapshot[applied={T|T < 7316275088611618816}]
I20260808 14:39:32.810355 8449 mvcc.cc:205] Tried to move back new op lower bound from 7316275088611618816 to 7316275088550068224. Current Snapshot: MvccSnapshot[applied={T|T < 7316275088611618816 or (T in {7316275088611618816})}]
I20260808 14:39:32.811970 7906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:32.812078 7906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:32.812898 7906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e50a3b89972437694fd53face1d7edd: Sending DeleteTablet for 3 replicas of tablet 380ec29e9af448bc9d3f98189c08e7e1
I20260808 14:39:32.813282 8339 tablet_service.cc:1514] Processing DeleteTablet for tablet 380ec29e9af448bc9d3f98189c08e7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:32 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:42626
I20260808 14:39:32.813318 8191 tablet_service.cc:1514] Processing DeleteTablet for tablet 380ec29e9af448bc9d3f98189c08e7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:32 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:46402
I20260808 14:39:32.813583 8460 tablet_replica.cc:330] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: stopping tablet replica
I20260808 14:39:32.813568 8045 tablet_service.cc:1514] Processing DeleteTablet for tablet 380ec29e9af448bc9d3f98189c08e7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:32 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:40942
I20260808 14:39:32.813870 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 7977
I20260808 14:39:32.813815 8462 tablet_replica.cc:330] T 380ec29e9af448bc9d3f98189c08e7e1 P 5d0f6ba3d7d84414b6f6e57223cc5b0d: stopping tablet replica
I20260808 14:39:32.814635 8461 tablet_replica.cc:330] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: stopping tablet replica
I20260808 14:39:32.814723 8461 raft_consensus.cc:2229] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:32.814853 8461 raft_consensus.cc:2258] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:32.815510 8461 ts_tablet_manager.cc:1905] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:32.816998 8461 ts_tablet_manager.cc:1918] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:32.817061 8461 log.cc:1196] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/380ec29e9af448bc9d3f98189c08e7e1
I20260808 14:39:32.817263 8461 ts_tablet_manager.cc:1939] T 380ec29e9af448bc9d3f98189c08e7e1 P edf62f887e3449a9b6232b7f0aef380b: Deleting consensus metadata
I20260808 14:39:32.817683 7890 catalog_manager.cc:4841] TS edf62f887e3449a9b6232b7f0aef380b (127.20.81.2:42355): tablet 380ec29e9af448bc9d3f98189c08e7e1 (table test-table [id=ca9c2b7faa9f4dd8881bd8d6195dd6ea]) successfully deleted
I20260808 14:39:32.818084 8460 raft_consensus.cc:2229] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:32.818250 8460 raft_consensus.cc:2258] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:32.818791 8460 ts_tablet_manager.cc:1905] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:32.821022 8460 ts_tablet_manager.cc:1918] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:32.821099 8460 log.cc:1196] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/380ec29e9af448bc9d3f98189c08e7e1
I20260808 14:39:32.821381 8460 ts_tablet_manager.cc:1939] T 380ec29e9af448bc9d3f98189c08e7e1 P 32e3ade504924757ad8f98b74e6b801d: Deleting consensus metadata
I20260808 14:39:32.822093 7888 catalog_manager.cc:4841] TS 32e3ade504924757ad8f98b74e6b801d (127.20.81.3:36815): tablet 380ec29e9af448bc9d3f98189c08e7e1 (table test-table [id=ca9c2b7faa9f4dd8881bd8d6195dd6ea]) successfully deleted
W20260808 14:39:32.825711 7889 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:45817 (error 108)
I20260808 14:39:32.825955 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 8125
I20260808 14:39:32.826622 8426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:32.826155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:45817 (local address 127.0.0.1:40956)
0808 14:39:32.826532 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:32.826574 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356}
W20260808 14:39:32.826936 7889 catalog_manager.cc:4584] TS 5d0f6ba3d7d84414b6f6e57223cc5b0d (127.20.81.1:45817): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 380ec29e9af448bc9d3f98189c08e7e1: Network error: Client connection negotiation failed: client connection to 127.20.81.1:45817: connect: Connection refused (error 111)
I20260808 14:39:32.831897 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 8270
I20260808 14:39:32.839157 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 7870
2026-08-08T14:39:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1977 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T14:39:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:32Z Disabled control of system clock
I20260808 14:39:32.868444 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:32873
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:40059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:32873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:39:32.951655 8467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:32.951864 8467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:32.951884 8467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:32.953114 8467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:32.953155 8467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:32.953168 8467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:32.953182 8467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:32.953194 8467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:32.954470 8467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:32873
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:32873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:32.954675 8467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:32.954905 8467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:32.959620 8478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:32.959625 8475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:32.959614 8476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:32.959771 8467 server_base.cc:1034] running on GCE node
I20260808 14:39:32.960179 8467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:32.960510 8467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:32.961700 8467 hybrid_clock.cc:648] HybridClock initialized: now 1786199972961680 us; error 42 us; skew 500 ppm
I20260808 14:39:32.967582 8467 webserver.cc:460] Webserver started at http://127.20.81.62:38037/ using document root <none> and password file <none>
I20260808 14:39:32.967836 8467 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:32.967911 8467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:32.968073 8467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:32.969216 8467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "a13e657d448f4ef9b959d7b10f2548e8"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "fee8297e878ffe2ca21dfef2d2bea354"
server_key_iv: "fb900d51719d097d615b127084a02b6f"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.969585 8467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "a13e657d448f4ef9b959d7b10f2548e8"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "fee8297e878ffe2ca21dfef2d2bea354"
server_key_iv: "fb900d51719d097d615b127084a02b6f"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.970903 8467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:39:32.971653 8484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:32.971838 8467 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:32.971951 8467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "a13e657d448f4ef9b959d7b10f2548e8"
format_stamp: "Formatted at 2026-08-08 14:39:32 on dist-test-slave-8n49"
server_key: "fee8297e878ffe2ca21dfef2d2bea354"
server_key_iv: "fb900d51719d097d615b127084a02b6f"
server_key_version: "encryptionkey@0"
I20260808 14:39:32.972025 8467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:32.998495 8467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:32.998847 8467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:32.999023 8467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:33.003314 8467 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:32873
I20260808 14:39:33.003350 8543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:32873 every 8 connection(s)
I20260808 14:39:33.003712 8467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:33.004742 8544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:33.007053 8544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8: Bootstrap starting.
I20260808 14:39:33.007673 8544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:33.007982 8544 log.cc:824] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:33.008718 8544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8: No bootstrap required, opened a new log
I20260808 14:39:33.010325 8544 raft_consensus.cc:348] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a13e657d448f4ef9b959d7b10f2548e8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32873 } }
I20260808 14:39:33.010470 8544 raft_consensus.cc:374] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:33.010493 8544 raft_consensus.cc:729] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13e657d448f4ef9b959d7b10f2548e8, State: Initialized, Role: FOLLOWER
I20260808 14:39:33.010665 8544 consensus_queue.cc:260] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a13e657d448f4ef9b959d7b10f2548e8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32873 } }
I20260808 14:39:33.010730 8544 raft_consensus.cc:388] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:33.010751 8544 raft_consensus.cc:482] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:33.010804 8544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:33.011330 8544 raft_consensus.cc:504] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a13e657d448f4ef9b959d7b10f2548e8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32873 } }
I20260808 14:39:33.011418 8544 leader_election.cc:302] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a13e657d448f4ef9b959d7b10f2548e8; no voters:
I20260808 14:39:33.011600 8544 leader_election.cc:288] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:33.011667 8548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:33.011896 8548 raft_consensus.cc:686] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [term 1 LEADER]: Becoming Leader. State: Replica: a13e657d448f4ef9b959d7b10f2548e8, State: Running, Role: LEADER
I20260808 14:39:33.011894 8544 sys_catalog.cc:564] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:33.012030 8548 consensus_queue.cc:237] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a13e657d448f4ef9b959d7b10f2548e8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32873 } }
I20260808 14:39:33.012483 8551 sys_catalog.cc:455] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a13e657d448f4ef9b959d7b10f2548e8. Latest consensus state: current_term: 1 leader_uuid: "a13e657d448f4ef9b959d7b10f2548e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a13e657d448f4ef9b959d7b10f2548e8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32873 } } }
I20260808 14:39:33.012591 8551 sys_catalog.cc:458] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:33.012607 8549 sys_catalog.cc:455] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a13e657d448f4ef9b959d7b10f2548e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a13e657d448f4ef9b959d7b10f2548e8" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32873 } } }
I20260808 14:39:33.012696 8549 sys_catalog.cc:458] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:33.013180 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 8467
I20260808 14:39:33.013289 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:33.013530 20804 external_mini_cluster.cc:1428] Setting key d4c20354ada5d4068837d4d8f894897e
I20260808 14:39:33.013458 8559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:33.014153 8559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:33.016433 8559 catalog_manager.cc:1347] Generated new cluster ID: 9cafe458e1c34b818a2c1ecdb7f36823
I20260808 14:39:33.016487 8559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:33.019325 8572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.014063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56124 (local address 127.20.81.62:32873)
0808 14:39:33.014274 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.014284 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.014316 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:39:33.014437 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.014444 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.014514 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.014672 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:33.014912 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.016020 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.017162 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.017768 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.017880 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.018632 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:33.018636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:33.018636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:33.018835 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:33.018875 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:33.018888 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:33.018961 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.019057 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.019129 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":78,"threads_started":1}
I20260808 14:39:33.033851 8559 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:33.034584 8559 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:33.042454 8559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8: Generated new TSK 0
I20260808 14:39:33.042654 8559 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:33.045183 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:32873
--builtin_ntp_servers=127.20.81.20:40059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:39:33.127840 8574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:33.128079 8574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:33.128115 8574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:33.129317 8574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:33.129387 8574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:33.129433 8574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:39:33.130832 8574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:32873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:33.131112 8574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:33.131414 8574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:33.137215 8580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:33.137293 8582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:33.137250 8579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:33.137540 8574 server_base.cc:1034] running on GCE node
I20260808 14:39:33.137741 8574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:33.137984 8574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:33.139158 8574 hybrid_clock.cc:648] HybridClock initialized: now 1786199973139144 us; error 34 us; skew 500 ppm
I20260808 14:39:33.140604 8574 webserver.cc:460] Webserver started at http://127.20.81.1:39451/ using document root <none> and password file <none>
I20260808 14:39:33.140875 8574 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:33.140935 8574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:33.141054 8574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:33.142463 8574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "508ffaccec204a0ea7e742d02a548dd0"
format_stamp: "Formatted at 2026-08-08 14:39:33 on dist-test-slave-8n49"
server_key: "34cdfa860e370aa52b2c6ba0f3e892b3"
server_key_iv: "4c7759a02184fd41157c5e1d0d73f14d"
server_key_version: "encryptionkey@0"
I20260808 14:39:33.142786 8574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "508ffaccec204a0ea7e742d02a548dd0"
format_stamp: "Formatted at 2026-08-08 14:39:33 on dist-test-slave-8n49"
server_key: "34cdfa860e370aa52b2c6ba0f3e892b3"
server_key_iv: "4c7759a02184fd41157c5e1d0d73f14d"
server_key_version: "encryptionkey@0"
I20260808 14:39:33.144023 8574 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:33.144748 8589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:33.144943 8574 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:33.145044 8574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "508ffaccec204a0ea7e742d02a548dd0"
format_stamp: "Formatted at 2026-08-08 14:39:33 on dist-test-slave-8n49"
server_key: "34cdfa860e370aa52b2c6ba0f3e892b3"
server_key_iv: "4c7759a02184fd41157c5e1d0d73f14d"
server_key_version: "encryptionkey@0"
I20260808 14:39:33.145138 8574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:33.166253 8574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:33.166654 8574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:33.166827 8574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:33.167119 8574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:33.167502 8574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:33.167562 8574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:33.167616 8574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:33.167647 8574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:33.174013 8574 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:45767
I20260808 14:39:33.174062 8716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:45767 every 8 connection(s)
I20260808 14:39:33.174438 8574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:39:33.179767 8572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.175268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:58437 (local address 127.20.81.62:32873)
0808 14:39:33.175331 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.175333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.175574 (+ 241us) server_negotiation.cc:407] Connection header received
0808 14:39:33.176090 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.176091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.176105 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.176159 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:33.176855 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.177360 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.178401 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.178625 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.178702 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.179487 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:33.179488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:33.179488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:33.179493 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:33.179510 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:33.179514 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:33.179559 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.179672 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.179704 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:39:33.179983 8719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.175233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:32873 (local address 127.20.81.1:58437)
0808 14:39:33.175449 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:33.175484 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:33.175998 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:33.176214 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:33.176218 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:33.176226 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:33.176781 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.176786 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.177469 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.177470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.178294 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.178297 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.178719 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.178720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.178835 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.179335 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:39:33.179335 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:33.179364 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:39:33.179389 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:33.179586 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:33.179591 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:33.179594 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:33.179650 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:39:33.179734 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260808 14:39:33.180598 8717 heartbeater.cc:347] Connected to a master server at 127.20.81.62:32873
I20260808 14:39:33.180699 8717 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:33.180859 8717 heartbeater.cc:511] Master 127.20.81.62:32873 requested a full tablet report, sending...
I20260808 14:39:33.181006 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 8574
I20260808 14:39:33.181124 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:39:33.181330 20804 external_mini_cluster.cc:1428] Setting key 1ee7d0ac241d208f0106418ad9c2b899
I20260808 14:39:33.181469 8504 ts_manager.cc:194] Registered new tserver with Master: 508ffaccec204a0ea7e742d02a548dd0 (127.20.81.1:45767)
I20260808 14:39:33.182379 8504 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.1:58437
I20260808 14:39:33.182492 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:32873
--builtin_ntp_servers=127.20.81.20:40059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:39:33.266108 8720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:33.266340 8720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:33.266373 8720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:33.267508 8720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:33.267576 8720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:33.267619 8720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:39:33.269037 8720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:32873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:33.269304 8720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:33.269618 8720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:33.274811 8728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:33.274729 8725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:33.274933 8720 server_base.cc:1034] running on GCE node
W20260808 14:39:33.274718 8726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:33.275216 8720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:33.275471 8720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:33.276638 8720 hybrid_clock.cc:648] HybridClock initialized: now 1786199973276632 us; error 36 us; skew 500 ppm
I20260808 14:39:33.278033 8720 webserver.cc:460] Webserver started at http://127.20.81.2:41043/ using document root <none> and password file <none>
I20260808 14:39:33.278306 8720 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:33.278381 8720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:33.278543 8720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:33.279596 8720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "98f352000e8a4fbeadc7283acf0a2362"
format_stamp: "Formatted at 2026-08-08 14:39:33 on dist-test-slave-8n49"
server_key: "5155c8852de2361b4269f47f37a4b095"
server_key_iv: "32c8864f8e9fbfa8271d68443e8c6df7"
server_key_version: "encryptionkey@0"
I20260808 14:39:33.279970 8720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "98f352000e8a4fbeadc7283acf0a2362"
format_stamp: "Formatted at 2026-08-08 14:39:33 on dist-test-slave-8n49"
server_key: "5155c8852de2361b4269f47f37a4b095"
server_key_iv: "32c8864f8e9fbfa8271d68443e8c6df7"
server_key_version: "encryptionkey@0"
I20260808 14:39:33.281363 8720 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:39:33.282075 8735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:33.282243 8720 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:39:33.282344 8720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "98f352000e8a4fbeadc7283acf0a2362"
format_stamp: "Formatted at 2026-08-08 14:39:33 on dist-test-slave-8n49"
server_key: "5155c8852de2361b4269f47f37a4b095"
server_key_iv: "32c8864f8e9fbfa8271d68443e8c6df7"
server_key_version: "encryptionkey@0"
I20260808 14:39:33.282428 8720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:33.295475 8720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:33.295753 8720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:33.295899 8720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:33.296119 8720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:33.296438 8720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:33.296494 8720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:33.296535 8720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:33.296619 8720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:33.302517 8720 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:45739
I20260808 14:39:33.302572 8860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:45739 every 8 connection(s)
I20260808 14:39:33.302881 8720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:39:33.307782 8572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.303590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:55649 (local address 127.20.81.62:32873)
0808 14:39:33.303658 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.303660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.303903 (+ 243us) server_negotiation.cc:407] Connection header received
0808 14:39:33.304379 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.304380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.304391 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.304459 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:33.305176 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.305671 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.306598 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.306784 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.306840 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.307563 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:33.307565 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:33.307565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:33.307569 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:33.307583 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:33.307587 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:33.307638 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.307700 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.307723 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:39:33.307998 8863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.303578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:32873 (local address 127.20.81.2:55649)
0808 14:39:33.303773 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:33.303813 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:33.304284 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:33.304510 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:33.304513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:33.304520 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:33.305090 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.305095 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.305751 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.305751 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.306513 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.306515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.306862 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.306863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.306974 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.307430 (+ 456us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:39:33.307431 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:33.307460 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:39:33.307482 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:33.307639 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:33.307641 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:33.307643 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:39:33.307688 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:39:33.307758 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
I20260808 14:39:33.308344 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 8720
I20260808 14:39:33.308459 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:39:33.308691 20804 external_mini_cluster.cc:1428] Setting key 7b7fe2af07c81c316843de551d8e9abf
I20260808 14:39:33.308894 8861 heartbeater.cc:347] Connected to a master server at 127.20.81.62:32873
I20260808 14:39:33.309003 8861 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:33.309201 8861 heartbeater.cc:511] Master 127.20.81.62:32873 requested a full tablet report, sending...
I20260808 14:39:33.309640 8504 ts_manager.cc:194] Registered new tserver with Master: 98f352000e8a4fbeadc7283acf0a2362 (127.20.81.2:45739)
I20260808 14:39:33.309672 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:32873
--builtin_ntp_servers=127.20.81.20:40059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:39:33.310052 8504 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.2:55649
W20260808 14:39:33.397403 8864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:33.397610 8864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:33.397634 8864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:33.398718 8864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:33.398752 8864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:33.398777 8864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:39:33.400048 8864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:32873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:33.400245 8864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:33.400501 8864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:33.405447 8870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:33.405447 8872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:33.405490 8869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:33.405700 8864 server_base.cc:1034] running on GCE node
I20260808 14:39:33.405968 8864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:33.406211 8864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:33.407382 8864 hybrid_clock.cc:648] HybridClock initialized: now 1786199973407359 us; error 41 us; skew 500 ppm
I20260808 14:39:33.408713 8864 webserver.cc:460] Webserver started at http://127.20.81.3:34699/ using document root <none> and password file <none>
I20260808 14:39:33.408983 8864 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:33.409053 8864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:33.409193 8864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:33.410260 8864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "8dd4d6b521964b06b2bd781f6588ef01"
format_stamp: "Formatted at 2026-08-08 14:39:33 on dist-test-slave-8n49"
server_key: "283d508b2ea154beac02bec10782f436"
server_key_iv: "2c04f9b20c8c82d0dbc1ca2672366453"
server_key_version: "encryptionkey@0"
I20260808 14:39:33.410637 8864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "8dd4d6b521964b06b2bd781f6588ef01"
format_stamp: "Formatted at 2026-08-08 14:39:33 on dist-test-slave-8n49"
server_key: "283d508b2ea154beac02bec10782f436"
server_key_iv: "2c04f9b20c8c82d0dbc1ca2672366453"
server_key_version: "encryptionkey@0"
I20260808 14:39:33.412024 8864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:33.413030 8880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:33.413250 8864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:39:33.413352 8864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "8dd4d6b521964b06b2bd781f6588ef01"
format_stamp: "Formatted at 2026-08-08 14:39:33 on dist-test-slave-8n49"
server_key: "283d508b2ea154beac02bec10782f436"
server_key_iv: "2c04f9b20c8c82d0dbc1ca2672366453"
server_key_version: "encryptionkey@0"
I20260808 14:39:33.413434 8864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:33.456776 8864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:33.457134 8864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:33.457299 8864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:33.457567 8864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:33.457947 8864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:33.458003 8864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:33.458058 8864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:33.458086 8864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:33.463840 8864 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:35015
I20260808 14:39:33.463929 9008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:35015 every 8 connection(s)
I20260808 14:39:33.464286 8864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:39:33.465965 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 8864
I20260808 14:39:33.466101 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:39:33.466300 20804 external_mini_cluster.cc:1428] Setting key 02177aa1048b7e94862894eb2da8de1c
I20260808 14:39:33.469859 8572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.465098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:60033 (local address 127.20.81.62:32873)
0808 14:39:33.465165 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.465167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.465402 (+ 235us) server_negotiation.cc:407] Connection header received
0808 14:39:33.465932 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.465934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.465948 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.466004 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:33.466919 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.467442 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.468461 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.468687 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.468767 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.469565 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:33.469567 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:33.469567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:33.469572 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:33.469588 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:33.469593 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:33.469661 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.469745 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.469778 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:39:33.470080 9011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.465082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:32873 (local address 127.20.81.3:60033)
0808 14:39:33.465271 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:33.465306 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:33.465818 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:33.466075 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:33.466079 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:33.466090 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:33.466832 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.466839 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.467549 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.467550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.468366 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.468368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.468775 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.468777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.468923 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.469425 (+ 502us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:39:33.469425 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:33.469453 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:39:33.469476 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:33.469663 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:33.469670 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:33.469673 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:33.469747 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:39:33.469849 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260808 14:39:33.470548 9009 heartbeater.cc:347] Connected to a master server at 127.20.81.62:32873
I20260808 14:39:33.470628 9009 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:33.470772 9009 heartbeater.cc:511] Master 127.20.81.62:32873 requested a full tablet report, sending...
I20260808 14:39:33.471091 8504 ts_manager.cc:194] Registered new tserver with Master: 8dd4d6b521964b06b2bd781f6588ef01 (127.20.81.3:35015)
I20260808 14:39:33.471472 8504 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.3:60033
I20260808 14:39:33.478020 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:39:33.482227 8572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.479434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56132 (local address 127.20.81.62:32873)
0808 14:39:33.479508 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.479522 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.479593 (+ 71us) server_negotiation.cc:407] Connection header received
0808 14:39:33.479633 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.479634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.479644 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.479691 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:33.479818 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.480271 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.481021 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.481196 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.481248 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.481952 (+ 704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:33.481953 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:33.481953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:33.481956 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:33.481967 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:33.481970 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:33.482034 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.482096 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.482127 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:39:33.483942 8504 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56132:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:39:33.485751 8504 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:39:33.492348 9022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.488176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35742 (local address 127.20.81.1:45767)
0808 14:39:33.488388 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.488393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.488404 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:39:33.488451 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.488453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.488470 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.488597 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:33.488774 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.489923 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.491467 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.491949 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.492040 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.492142 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.492225 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.492262 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":90,"threads_started":1}
I20260808 14:39:33.492344 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.487986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:45767 (local address 127.0.0.1:35742)
0808 14:39:33.488196 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:33.488235 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:33.488307 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:33.488594 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:33.488598 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:33.488600 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:33.488678 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.488680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.490025 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.490026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.491362 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.491365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.492044 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.492045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.492121 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.492134 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:39:33.492211 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:39:33.492266 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":42,"thread_start_us":56,"threads_started":1}
I20260808 14:39:33.492491 9020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.487986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:35015 (local address 127.0.0.1:60612)
0808 14:39:33.488318 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:33.488328 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:33.488367 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:33.489189 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:33.489190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:33.489192 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:33.489242 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.489244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.490133 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.490134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.491362 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.491365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.492248 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.492248 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.492304 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.492307 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:33.492337 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 14:39:33.492365 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":72,"thread_start_us":68,"threads_started":1}
I20260808 14:39:33.492743 9023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.488385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59132 (local address 127.20.81.2:45739)
0808 14:39:33.488616 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.488620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.488653 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:39:33.488750 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.488752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.488769 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.488843 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:33.488953 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.489981 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.491262 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.491980 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.492068 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.492157 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.492599 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.492651 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":86,"threads_started":1}
I20260808 14:39:33.492908 9017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.488179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:45739 (local address 127.0.0.1:59132)
0808 14:39:33.488597 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:33.488608 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:33.488663 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:33.488843 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:33.488844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:33.488846 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:33.488891 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.488892 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.490071 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.490072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.491174 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.491177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.492199 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.492200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.492272 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.492276 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:33.492323 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:39:33.492365 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":78,"thread_start_us":78,"threads_started":1}
I20260808 14:39:33.493178 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.488065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60612 (local address 127.20.81.3:35015)
0808 14:39:33.488735 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.488739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.488749 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:39:33.489071 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.489074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.489090 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.489191 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:33.489317 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.489995 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.491455 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.492159 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.492715 (+ 556us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.493010 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.493040 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.493088 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":100,"threads_started":1}
I20260808 14:39:33.493396 8648 tablet_service.cc:1467] Processing CreateTablet for tablet 7092bdeb7c44494aa1bec0674ae9cfd6 (DEFAULT_TABLE table=test-table [id=22784ef42d6f4de9a60cee0b41c54e27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:33.493561 8789 tablet_service.cc:1467] Processing CreateTablet for tablet 7092bdeb7c44494aa1bec0674ae9cfd6 (DEFAULT_TABLE table=test-table [id=22784ef42d6f4de9a60cee0b41c54e27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:33.493786 8648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7092bdeb7c44494aa1bec0674ae9cfd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:33.493723 8938 tablet_service.cc:1467] Processing CreateTablet for tablet 7092bdeb7c44494aa1bec0674ae9cfd6 (DEFAULT_TABLE table=test-table [id=22784ef42d6f4de9a60cee0b41c54e27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:33.493847 8789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7092bdeb7c44494aa1bec0674ae9cfd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:33.494117 8938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7092bdeb7c44494aa1bec0674ae9cfd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:33.496721 9025 tablet_bootstrap.cc:492] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: Bootstrap starting.
I20260808 14:39:33.497471 9026 tablet_bootstrap.cc:492] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: Bootstrap starting.
I20260808 14:39:33.497529 9025 tablet_bootstrap.cc:654] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:33.497824 9025 log.cc:824] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:33.498135 9026 tablet_bootstrap.cc:654] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:33.498449 9026 log.cc:824] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:33.498588 9025 tablet_bootstrap.cc:492] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: No bootstrap required, opened a new log
I20260808 14:39:33.498660 9025 ts_tablet_manager.cc:1397] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:39:33.498811 9027 tablet_bootstrap.cc:492] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0: Bootstrap starting.
I20260808 14:39:33.499344 9027 tablet_bootstrap.cc:654] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:33.499636 9027 log.cc:824] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:33.500368 9027 tablet_bootstrap.cc:492] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0: No bootstrap required, opened a new log
I20260808 14:39:33.500368 9026 tablet_bootstrap.cc:492] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: No bootstrap required, opened a new log
I20260808 14:39:33.500442 9027 ts_tablet_manager.cc:1397] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:39:33.500442 9026 ts_tablet_manager.cc:1397] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:39:33.501195 9025 raft_consensus.cc:348] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } }
I20260808 14:39:33.501355 9025 raft_consensus.cc:374] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:33.501401 9025 raft_consensus.cc:729] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd4d6b521964b06b2bd781f6588ef01, State: Initialized, Role: FOLLOWER
I20260808 14:39:33.501526 9025 consensus_queue.cc:260] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } }
I20260808 14:39:33.501801 9025 ts_tablet_manager.cc:1428] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:39:33.501935 9009 heartbeater.cc:503] Master 127.20.81.62:32873 was elected leader, sending a full tablet report...
I20260808 14:39:33.503050 9026 raft_consensus.cc:348] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } }
I20260808 14:39:33.503050 9027 raft_consensus.cc:348] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } }
I20260808 14:39:33.503212 9026 raft_consensus.cc:374] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:33.503212 9027 raft_consensus.cc:374] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:33.503248 9026 raft_consensus.cc:729] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98f352000e8a4fbeadc7283acf0a2362, State: Initialized, Role: FOLLOWER
I20260808 14:39:33.503248 9027 raft_consensus.cc:729] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508ffaccec204a0ea7e742d02a548dd0, State: Initialized, Role: FOLLOWER
I20260808 14:39:33.503362 9027 consensus_queue.cc:260] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } }
I20260808 14:39:33.503362 9026 consensus_queue.cc:260] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } }
I20260808 14:39:33.503628 9026 ts_tablet_manager.cc:1428] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:39:33.503628 9027 ts_tablet_manager.cc:1428] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:39:33.503676 8861 heartbeater.cc:503] Master 127.20.81.62:32873 was elected leader, sending a full tablet report...
I20260808 14:39:33.503756 8717 heartbeater.cc:503] Master 127.20.81.62:32873 was elected leader, sending a full tablet report...
I20260808 14:39:33.521145 9033 raft_consensus.cc:482] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:33.521240 9033 raft_consensus.cc:504] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } }
I20260808 14:39:33.521641 9033 leader_election.cc:288] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98f352000e8a4fbeadc7283acf0a2362 (127.20.81.2:45739), 8dd4d6b521964b06b2bd781f6588ef01 (127.20.81.3:35015)
I20260808 14:39:33.524405 8719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.521781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:45739 (local address 127.20.81.1:39333)
0808 14:39:33.521866 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:33.521879 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:33.521926 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:33.522081 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:33.522082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:33.522084 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:33.522152 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.522154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.522787 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.522789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.523542 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.523544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.524159 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.524160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.524236 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.524241 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:39:33.524299 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:39:33.524343 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 14:39:33.524425 9023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.521871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:39333 (local address 127.20.81.2:45739)
0808 14:39:33.521916 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.521918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.521927 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:33.521993 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.521994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.522004 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.522079 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:33.522231 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.522702 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.523636 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.524090 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.524158 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.524169 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.524306 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.524353 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:39:33.524703 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.521860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:43977 (local address 127.20.81.3:35015)
0808 14:39:33.521909 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.521912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.522029 (+ 117us) server_negotiation.cc:407] Connection header received
0808 14:39:33.522099 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.522100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.522111 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.522181 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:33.522328 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.522789 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.523716 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.524257 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.524317 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.524326 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.524593 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.524642 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:39:33.524713 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.521813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:35015 (local address 127.20.81.1:43977)
0808 14:39:33.521962 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:33.521970 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:33.522044 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:33.522185 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:33.522186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:33.522187 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:33.522259 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.522261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.522872 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.522873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.523626 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:33.523628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.524370 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.524371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:33.524450 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.524454 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:33.524536 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:39:33.524616 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":1,"thread_start_us":80,"threads_started":1}
I20260808 14:39:33.524941 8812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7092bdeb7c44494aa1bec0674ae9cfd6" candidate_uuid: "508ffaccec204a0ea7e742d02a548dd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98f352000e8a4fbeadc7283acf0a2362" is_pre_election: true
I20260808 14:39:33.525054 8812 raft_consensus.cc:2454] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ffaccec204a0ea7e742d02a548dd0 in term 0.
I20260808 14:39:33.525022 8959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7092bdeb7c44494aa1bec0674ae9cfd6" candidate_uuid: "508ffaccec204a0ea7e742d02a548dd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd4d6b521964b06b2bd781f6588ef01" is_pre_election: true
I20260808 14:39:33.525135 8959 raft_consensus.cc:2454] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ffaccec204a0ea7e742d02a548dd0 in term 0.
I20260808 14:39:33.525306 8592 leader_election.cc:302] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ffaccec204a0ea7e742d02a548dd0, 98f352000e8a4fbeadc7283acf0a2362; no voters:
I20260808 14:39:33.525465 9033 raft_consensus.cc:2781] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:39:33.525530 9033 raft_consensus.cc:482] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:39:33.525548 9033 raft_consensus.cc:3037] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:33.526217 9033 raft_consensus.cc:504] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } }
I20260808 14:39:33.526422 9033 leader_election.cc:288] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [CANDIDATE]: Term 1 election: Requested vote from peers 98f352000e8a4fbeadc7283acf0a2362 (127.20.81.2:45739), 8dd4d6b521964b06b2bd781f6588ef01 (127.20.81.3:35015)
I20260808 14:39:33.526515 8959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7092bdeb7c44494aa1bec0674ae9cfd6" candidate_uuid: "508ffaccec204a0ea7e742d02a548dd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd4d6b521964b06b2bd781f6588ef01"
I20260808 14:39:33.526566 8812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7092bdeb7c44494aa1bec0674ae9cfd6" candidate_uuid: "508ffaccec204a0ea7e742d02a548dd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98f352000e8a4fbeadc7283acf0a2362"
I20260808 14:39:33.526599 8959 raft_consensus.cc:3037] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:33.526643 8812 raft_consensus.cc:3037] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:33.527525 8959 raft_consensus.cc:2454] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ffaccec204a0ea7e742d02a548dd0 in term 1.
I20260808 14:39:33.527535 8812 raft_consensus.cc:2454] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ffaccec204a0ea7e742d02a548dd0 in term 1.
I20260808 14:39:33.527746 8594 leader_election.cc:302] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ffaccec204a0ea7e742d02a548dd0, 8dd4d6b521964b06b2bd781f6588ef01; no voters:
I20260808 14:39:33.527880 9033 raft_consensus.cc:2781] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:33.528040 9033 raft_consensus.cc:686] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [term 1 LEADER]: Becoming Leader. State: Replica: 508ffaccec204a0ea7e742d02a548dd0, State: Running, Role: LEADER
I20260808 14:39:33.528146 9033 consensus_queue.cc:237] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } }
I20260808 14:39:33.529023 8504 catalog_manager.cc:5495] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 508ffaccec204a0ea7e742d02a548dd0 (127.20.81.1). New cstate: current_term: 1 leader_uuid: "508ffaccec204a0ea7e742d02a548dd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508ffaccec204a0ea7e742d02a548dd0" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 45767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260808 14:39:33.537915 9022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.535647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35746 (local address 127.20.81.1:45767)
0808 14:39:33.535711 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:33.535713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:33.535722 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:33.535794 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:33.535794 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:33.535811 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:33.535875 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:39:33.535988 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.536454 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.537212 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:33.537389 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:33.537445 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:33.537568 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:39:33.537651 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:39:33.537718 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:33.537766 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 14:39:33.537776 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:39:33.539618 8959 raft_consensus.cc:1261] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [term 1 FOLLOWER]: Refusing update from remote peer 508ffaccec204a0ea7e742d02a548dd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:33.539642 8812 raft_consensus.cc:1261] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [term 1 FOLLOWER]: Refusing update from remote peer 508ffaccec204a0ea7e742d02a548dd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:33.539990 9035 consensus_queue.cc:1035] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98f352000e8a4fbeadc7283acf0a2362" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:33.540114 9033 consensus_queue.cc:1035] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 508ffaccec204a0ea7e742d02a548dd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd4d6b521964b06b2bd781f6588ef01" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:33.543329 9038 mvcc.cc:205] Tried to move back new op lower bound from 7316275091615686656 to 7316275091571924992. Current Snapshot: MvccSnapshot[applied={T|T < 7316275091615686656 or (T in {7316275091615686656})}]
I20260808 14:39:33.543396 9039 mvcc.cc:205] Tried to move back new op lower bound from 7316275091615686656 to 7316275091571924992. Current Snapshot: MvccSnapshot[applied={T|T < 7316275091615686656}]
I20260808 14:39:33.545176 8504 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:33.545274 8504 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:33.546061 8504 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a13e657d448f4ef9b959d7b10f2548e8: Sending DeleteTablet for 3 replicas of tablet 7092bdeb7c44494aa1bec0674ae9cfd6
I20260808 14:39:33.546422 8648 tablet_service.cc:1514] Processing DeleteTablet for tablet 7092bdeb7c44494aa1bec0674ae9cfd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:33 UTC) from {username='slave'} at 127.0.0.1:35742
I20260808 14:39:33.546446 8938 tablet_service.cc:1514] Processing DeleteTablet for tablet 7092bdeb7c44494aa1bec0674ae9cfd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:33 UTC) from {username='slave'} at 127.0.0.1:60612
I20260808 14:39:33.546572 8789 tablet_service.cc:1514] Processing DeleteTablet for tablet 7092bdeb7c44494aa1bec0674ae9cfd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:33 UTC) from {username='slave'} at 127.0.0.1:59132
I20260808 14:39:33.546761 9048 tablet_replica.cc:330] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: stopping tablet replica
I20260808 14:39:33.546794 9050 tablet_replica.cc:330] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: stopping tablet replica
I20260808 14:39:33.546906 9050 raft_consensus.cc:2229] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:33.547011 9050 raft_consensus.cc:2258] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:33.547008 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 8574
I20260808 14:39:33.547444 9050 ts_tablet_manager.cc:1905] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:33.549782 9050 ts_tablet_manager.cc:1918] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:33.549865 9050 log.cc:1196] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/7092bdeb7c44494aa1bec0674ae9cfd6
I20260808 14:39:33.550184 9050 ts_tablet_manager.cc:1939] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 98f352000e8a4fbeadc7283acf0a2362: Deleting consensus metadata
I20260808 14:39:33.550794 8486 catalog_manager.cc:4841] TS 98f352000e8a4fbeadc7283acf0a2362 (127.20.81.2:45739): tablet 7092bdeb7c44494aa1bec0674ae9cfd6 (table test-table [id=22784ef42d6f4de9a60cee0b41c54e27]) successfully deleted
I20260808 14:39:33.551234 9048 raft_consensus.cc:2229] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:33.551373 9048 raft_consensus.cc:2258] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:33.551802 9048 ts_tablet_manager.cc:1905] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:33.553764 9048 ts_tablet_manager.cc:1918] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:33.553844 9048 log.cc:1196] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/7092bdeb7c44494aa1bec0674ae9cfd6
I20260808 14:39:33.554092 9048 ts_tablet_manager.cc:1939] T 7092bdeb7c44494aa1bec0674ae9cfd6 P 8dd4d6b521964b06b2bd781f6588ef01: Deleting consensus metadata
I20260808 14:39:33.554589 8488 catalog_manager.cc:4841] TS 8dd4d6b521964b06b2bd781f6588ef01 (127.20.81.3:35015): tablet 7092bdeb7c44494aa1bec0674ae9cfd6 (table test-table [id=22784ef42d6f4de9a60cee0b41c54e27]) successfully deleted
W20260808 14:39:33.557222 8486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:45767 (error 108)
I20260808 14:39:33.557401 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 8720
I20260808 14:39:33.558790 9017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:33.557587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:45767 (local address 127.0.0.1:35756)
0808 14:39:33.558688 (+ 1101us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:33.558744 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1071}
W20260808 14:39:33.558956 8486 catalog_manager.cc:4584] TS 508ffaccec204a0ea7e742d02a548dd0 (127.20.81.1:45767): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7092bdeb7c44494aa1bec0674ae9cfd6: Network error: Client connection negotiation failed: client connection to 127.20.81.1:45767: connect: Connection refused (error 111)
I20260808 14:39:33.564317 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 8864
I20260808 14:39:33.570484 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 8467
2026-08-08T14:39:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (730 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:33 dist-test-slave-8n49 krb5kdc[9054](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:33 dist-test-slave-8n49 krb5kdc[9054](info): set up 2 sockets
Aug 08 14:39:33 dist-test-slave-8n49 krb5kdc[9054](info): commencing operation
krb5kdc: starting...
W20260808 14:39:34.640781 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:34 dist-test-slave-8n49 krb5kdc[9054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:39:34.759976 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:39459
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:39459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:34.841832 9068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:34.842088 9068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:34.842126 9068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:34.843267 9068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:34.843341 9068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:34.843366 9068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:34.843393 9068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:34.843425 9068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:34.844944 9068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:39459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:39459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:34.845227 9068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:34.845456 9068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:34.850324 9075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:34.850334 9079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:34.850371 9068 server_base.cc:1034] running on GCE node
W20260808 14:39:34.850337 9074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:34.850847 9068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:34.851095 9068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:34.852267 9068 hybrid_clock.cc:648] HybridClock initialized: now 1786199974852252 us; error 44 us; skew 500 ppm
Aug 08 14:39:34 dist-test-slave-8n49 krb5kdc[9054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199974, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:34.854862 9068 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:39:34.855309 9068 webserver.cc:460] Webserver started at http://127.20.81.62:43269/ using document root <none> and password file <none>
I20260808 14:39:34.855545 9068 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:34.855592 9068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:34.855772 9068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:34.856904 9068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "cb04912896fe4ad19c0bb4ec6ec68f48"
format_stamp: "Formatted at 2026-08-08 14:39:34 on dist-test-slave-8n49"
server_key: "25d7578ba28e040bba36395e285e1bdf"
server_key_iv: "7394b80a946e427e54a5867f01d1f666"
server_key_version: "encryptionkey@0"
I20260808 14:39:34.857277 9068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "cb04912896fe4ad19c0bb4ec6ec68f48"
format_stamp: "Formatted at 2026-08-08 14:39:34 on dist-test-slave-8n49"
server_key: "25d7578ba28e040bba36395e285e1bdf"
server_key_iv: "7394b80a946e427e54a5867f01d1f666"
server_key_version: "encryptionkey@0"
I20260808 14:39:34.858736 9068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:39:34.859575 9088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:34.859792 9068 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:34.859905 9068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "cb04912896fe4ad19c0bb4ec6ec68f48"
format_stamp: "Formatted at 2026-08-08 14:39:34 on dist-test-slave-8n49"
server_key: "25d7578ba28e040bba36395e285e1bdf"
server_key_iv: "7394b80a946e427e54a5867f01d1f666"
server_key_version: "encryptionkey@0"
I20260808 14:39:34.859983 9068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:34.878839 9068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:34.881085 9068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:34.881278 9068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:34.886495 9068 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:39459
I20260808 14:39:34.886535 9143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:39459 every 8 connection(s)
I20260808 14:39:34.886922 9068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:34.887812 9144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:34.890226 9144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48: Bootstrap starting.
I20260808 14:39:34.890782 9144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:34.891091 9144 log.cc:824] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:34.891800 9144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48: No bootstrap required, opened a new log
I20260808 14:39:34.893540 9144 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb04912896fe4ad19c0bb4ec6ec68f48" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39459 } }
I20260808 14:39:34.893683 9144 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:34.893731 9144 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb04912896fe4ad19c0bb4ec6ec68f48, State: Initialized, Role: FOLLOWER
I20260808 14:39:34.893898 9144 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb04912896fe4ad19c0bb4ec6ec68f48" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39459 } }
I20260808 14:39:34.893980 9144 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:34.894034 9144 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:34.894085 9144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:34.894611 9144 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb04912896fe4ad19c0bb4ec6ec68f48" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39459 } }
I20260808 14:39:34.894726 9144 leader_election.cc:302] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb04912896fe4ad19c0bb4ec6ec68f48; no voters:
I20260808 14:39:34.894913 9144 leader_election.cc:288] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:34.894936 9148 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:34.895175 9148 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [term 1 LEADER]: Becoming Leader. State: Replica: cb04912896fe4ad19c0bb4ec6ec68f48, State: Running, Role: LEADER
I20260808 14:39:34.895212 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 9068
I20260808 14:39:34.895185 9144 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:34.895334 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:34.895296 9148 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb04912896fe4ad19c0bb4ec6ec68f48" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39459 } }
I20260808 14:39:34.895553 20804 external_mini_cluster.cc:1428] Setting key 0ffd7da188a42e21901c1374027431f5
I20260808 14:39:34.895649 9148 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb04912896fe4ad19c0bb4ec6ec68f48. Latest consensus state: current_term: 1 leader_uuid: "cb04912896fe4ad19c0bb4ec6ec68f48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb04912896fe4ad19c0bb4ec6ec68f48" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39459 } } }
I20260808 14:39:34.895714 9148 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:34.896027 9149 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb04912896fe4ad19c0bb4ec6ec68f48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb04912896fe4ad19c0bb4ec6ec68f48" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39459 } } }
I20260808 14:39:34.896184 9149 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:34.896369 9155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:34.897007 9155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:34.899013 9155 catalog_manager.cc:1347] Generated new cluster ID: 9b99b8f95f194198aae715b3afe201c3
I20260808 14:39:34.899070 9155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:39:34 dist-test-slave-8n49 krb5kdc[9054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:34.908049 9164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:34.896363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34362 (local address 127.20.81.62:39459)
0808 14:39:34.896562 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:34.896573 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:34.896816 (+ 243us) server_negotiation.cc:407] Connection header received
0808 14:39:34.896944 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:34.896952 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:34.897010 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:34.898146 (+ 1136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:34.898224 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:34.899555 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:34.900679 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:34.901298 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:34.901400 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:34.904311 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:34.904315 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:34.904316 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:34.904328 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:34.906251 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:34.906673 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:34.906675 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:34.906676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:34.906789 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:34.907008 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:34.907008 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:34.907009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:34.907297 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:34.907434 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:34.907581 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 14:39:34.907815 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260808 14:39:34.919428 9155 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:34.920143 9155 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:34.929118 9155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48: Generated new TSK 0
I20260808 14:39:34.929309 9155 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.81.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
Entry for principal kudu/127.20.81.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab.
I20260808 14:39:34.958964 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:39459
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:35.043053 9172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:35.043304 9172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:35.043344 9172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:35.044509 9172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:35.044605 9172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:35.044662 9172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:39:35.046182 9172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.1.keytab
--principal=kudu/127.20.81.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:39459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:35.046464 9172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:35.046736 9172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:35.051838 9180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.051792 9182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.051800 9179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:35.052013 9172 server_base.cc:1034] running on GCE node
I20260808 14:39:35.052265 9172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:35.052495 9172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:35.053638 9172 hybrid_clock.cc:648] HybridClock initialized: now 1786199975053629 us; error 31 us; skew 500 ppm
Aug 08 14:39:35 dist-test-slave-8n49 krb5kdc[9054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199975, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:35.056406 9172 init.cc:377] Logged in from keytab as kudu/127.20.81.1@KRBTEST.COM (short username kudu)
I20260808 14:39:35.056888 9172 webserver.cc:460] Webserver started at http://127.20.81.1:44717/ using document root <none> and password file <none>
I20260808 14:39:35.057130 9172 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:35.057178 9172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:35.057337 9172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:35.058426 9172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "78bd364d326341e9ad737e4e857d848d"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "eb463b6c8bcb9fc14716f2bb289f1321"
server_key_iv: "45d22baec0a7845ece7e4a9ab3b17722"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.058807 9172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "78bd364d326341e9ad737e4e857d848d"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "eb463b6c8bcb9fc14716f2bb289f1321"
server_key_iv: "45d22baec0a7845ece7e4a9ab3b17722"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.060196 9172 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:35.061066 9189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.061244 9172 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.061331 9172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "78bd364d326341e9ad737e4e857d848d"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "eb463b6c8bcb9fc14716f2bb289f1321"
server_key_iv: "45d22baec0a7845ece7e4a9ab3b17722"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.061388 9172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:35.089543 9172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:35.091544 9172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:35.091660 9172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:35.091858 9172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:35.092208 9172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:35.092244 9172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.092268 9172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:35.092320 9172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.098839 9172 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:42797
I20260808 14:39:35.098896 9311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:42797 every 8 connection(s)
I20260808 14:39:35.099228 9172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:39:35.105113 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 9172
I20260808 14:39:35.105247 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
Aug 08 14:39:35 dist-test-slave-8n49 krb5kdc[9054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199975, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.1@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:35.105486 20804 external_mini_cluster.cc:1428] Setting key c16c1146a1e1b5eb6d3cd89102b5390b
I20260808 14:39:35.109037 9164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.099965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:33051 (local address 127.20.81.62:39459)
0808 14:39:35.100017 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.100019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.100232 (+ 213us) server_negotiation.cc:407] Connection header received
0808 14:39:35.100805 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.100806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.100819 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.100873 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:35.101802 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.102309 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.103272 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.103463 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.103515 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.105920 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:35.105922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:35.105922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:35.105929 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:35.107346 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:35.107897 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:35.107898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:35.107899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:35.107970 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:35.108277 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:35.108278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:35.108278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:35.108425 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:35.108500 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.108810 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.108918 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:39:35.109058 9314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.099917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:39459 (local address 127.20.81.1:33051)
0808 14:39:35.100099 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.100143 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:35.100716 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:35.100936 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:35.100939 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:35.101519 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:35.101724 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.101729 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.102394 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.102395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.103194 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.103196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.103545 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.103546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.103644 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.104178 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:35.104187 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:35.105847 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:35.107432 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:35.107441 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:35.107443 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:35.107815 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:35.108059 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:35.108060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:35.108060 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:35.108205 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:35.108496 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:35.108502 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:35.108671 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 14:39:35.108759 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:39:35.108883 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":105,"threads_started":1}
I20260808 14:39:35.109609 9312 heartbeater.cc:347] Connected to a master server at 127.20.81.62:39459
I20260808 14:39:35.109738 9312 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:35.109942 9312 heartbeater.cc:511] Master 127.20.81.62:39459 requested a full tablet report, sending...
I20260808 14:39:35.110495 9103 ts_manager.cc:194] Registered new tserver with Master: 78bd364d326341e9ad737e4e857d848d (127.20.81.1:42797)
I20260808 14:39:35.111480 9103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.1@KRBTEST.COM'} at 127.20.81.1:33051
WARNING: no policy specified for kudu/127.20.81.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
Entry for principal kudu/127.20.81.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab.
I20260808 14:39:35.131503 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:39459
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:35.213133 9317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:35.213536 9317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:35.213632 9317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:35.214831 9317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:35.214900 9317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:35.214946 9317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:39:35.216578 9317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.2.keytab
--principal=kudu/127.20.81.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:39459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:35.216856 9317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:35.217095 9317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:35.222255 9326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.222262 9324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.222262 9322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:35.222494 9317 server_base.cc:1034] running on GCE node
I20260808 14:39:35.222681 9317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:35.222915 9317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:35.224067 9317 hybrid_clock.cc:648] HybridClock initialized: now 1786199975224053 us; error 32 us; skew 500 ppm
Aug 08 14:39:35 dist-test-slave-8n49 krb5kdc[9054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199975, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:35.226588 9317 init.cc:377] Logged in from keytab as kudu/127.20.81.2@KRBTEST.COM (short username kudu)
I20260808 14:39:35.227051 9317 webserver.cc:460] Webserver started at http://127.20.81.2:44655/ using document root <none> and password file <none>
I20260808 14:39:35.227270 9317 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:35.227311 9317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:35.227401 9317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:35.228391 9317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "abc6a555b4424c35901e586520d2f3bc"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "ef5e24c89703cceae7bf174d29eade90"
server_key_iv: "c6f0c9867a875e890d3504f470ae0e3b"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.228809 9317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "abc6a555b4424c35901e586520d2f3bc"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "ef5e24c89703cceae7bf174d29eade90"
server_key_iv: "c6f0c9867a875e890d3504f470ae0e3b"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.230099 9317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:39:35.230779 9334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.230978 9317 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:39:35.231091 9317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "abc6a555b4424c35901e586520d2f3bc"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "ef5e24c89703cceae7bf174d29eade90"
server_key_iv: "c6f0c9867a875e890d3504f470ae0e3b"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.231164 9317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:35.252765 9317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:35.255086 9317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:35.255203 9317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:35.255374 9317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:35.255730 9317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:35.255790 9317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.255827 9317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:35.255859 9317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.261608 9317 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:45017
I20260808 14:39:35.261708 9453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:45017 every 8 connection(s)
I20260808 14:39:35.262017 9317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:39:35.266511 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 9317
I20260808 14:39:35.266649 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:39:35.266871 20804 external_mini_cluster.cc:1428] Setting key c5740ee2bd29e6c0cd953d6703c0f4ba
Aug 08 14:39:35 dist-test-slave-8n49 krb5kdc[9054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199975, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.2@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:35.272284 9164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.262859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:48929 (local address 127.20.81.62:39459)
0808 14:39:35.262929 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.262930 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.263176 (+ 246us) server_negotiation.cc:407] Connection header received
0808 14:39:35.263721 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.263722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.263735 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.263800 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:35.264897 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.265510 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.266552 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.266833 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.266913 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.269296 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:35.269297 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:35.269298 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:35.269307 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:35.270750 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:35.271251 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:35.271252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:35.271252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:35.271301 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:35.271605 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:35.271606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:35.271606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:35.271737 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:35.271791 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.272149 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.272218 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:39:35.272643 9456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.262846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:39459 (local address 127.20.81.2:48929)
0808 14:39:35.263024 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.263066 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:35.263603 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:35.263873 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:35.263878 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:35.264590 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:35.264792 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.264797 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.265606 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.265607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.266445 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.266448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.266921 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.266922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.267098 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.267694 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:35.267702 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:35.269178 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:35.270841 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:35.270849 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:35.270852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:35.271169 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:35.271371 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:35.271372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:35.271373 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:35.271525 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:35.271811 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:35.271819 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:35.272001 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 14:39:35.272131 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 14:39:35.272317 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260808 14:39:35.273190 9454 heartbeater.cc:347] Connected to a master server at 127.20.81.62:39459
I20260808 14:39:35.273305 9454 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:35.273532 9454 heartbeater.cc:511] Master 127.20.81.62:39459 requested a full tablet report, sending...
I20260808 14:39:35.273945 9103 ts_manager.cc:194] Registered new tserver with Master: abc6a555b4424c35901e586520d2f3bc (127.20.81.2:45017)
I20260808 14:39:35.274338 9103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.2@KRBTEST.COM'} at 127.20.81.2:48929
WARNING: no policy specified for kudu/127.20.81.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
Entry for principal kudu/127.20.81.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab.
I20260808 14:39:35.295365 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:39459
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:35.382346 9459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:35.382547 9459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:35.382570 9459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:35.383719 9459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:35.383760 9459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:35.383786 9459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:39:35.385304 9459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.3.keytab
--principal=kudu/127.20.81.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:39459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:35.385561 9459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:35.385793 9459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:35.390879 9467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.390928 9465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.390882 9464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:35.391213 9459 server_base.cc:1034] running on GCE node
I20260808 14:39:35.391430 9459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:35.391673 9459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:35.392802 9459 hybrid_clock.cc:648] HybridClock initialized: now 1786199975392781 us; error 38 us; skew 500 ppm
Aug 08 14:39:35 dist-test-slave-8n49 krb5kdc[9054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199975, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:35.395336 9459 init.cc:377] Logged in from keytab as kudu/127.20.81.3@KRBTEST.COM (short username kudu)
I20260808 14:39:35.395802 9459 webserver.cc:460] Webserver started at http://127.20.81.3:39325/ using document root <none> and password file <none>
I20260808 14:39:35.396099 9459 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:35.396173 9459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:35.396328 9459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:35.397573 9459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "1371965a10514a4a8dbfe3acb0019723"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "d890c3092dd6aa6e82fb9d62d7d21b68"
server_key_iv: "ade1ee31b41bff542ef48fd13be64426"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.397886 9459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "1371965a10514a4a8dbfe3acb0019723"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "d890c3092dd6aa6e82fb9d62d7d21b68"
server_key_iv: "ade1ee31b41bff542ef48fd13be64426"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.399327 9459 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:35.399981 9475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.400166 9459 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:35.400265 9459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "1371965a10514a4a8dbfe3acb0019723"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "d890c3092dd6aa6e82fb9d62d7d21b68"
server_key_iv: "ade1ee31b41bff542ef48fd13be64426"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.400323 9459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:35.413815 9459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:35.415496 9459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:35.415603 9459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:35.415776 9459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:35.416018 9459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:35.416047 9459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.416069 9459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:35.416081 9459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.421947 9459 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:39501
I20260808 14:39:35.422008 9597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:39501 every 8 connection(s)
I20260808 14:39:35.422323 9459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:39:35 dist-test-slave-8n49 krb5kdc[9054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199975, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.3@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:35.430749 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 9459
I20260808 14:39:35.430855 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:39:35.431110 20804 external_mini_cluster.cc:1428] Setting key f2bae92307fc8044a8d1b748fdf83142
I20260808 14:39:35.431762 9164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.423055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:53001 (local address 127.20.81.62:39459)
0808 14:39:35.423119 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.423121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.423300 (+ 179us) server_negotiation.cc:407] Connection header received
0808 14:39:35.423826 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.423828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.423841 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.423916 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:35.424908 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.425425 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.426394 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.426606 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.426671 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.428805 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:35.428807 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:35.428807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:35.428814 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:35.430169 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:35.430585 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:35.430587 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:35.430587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:35.430660 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:35.431015 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:35.431017 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:35.431017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:35.431176 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:35.431253 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.431568 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.431669 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:39:35.431931 9600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.423002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:39459 (local address 127.20.81.3:53001)
0808 14:39:35.423174 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.423216 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:35.423704 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:35.423988 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:35.423992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:35.424604 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:35.424808 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.424813 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.425507 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.425508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.426295 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.426297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.426689 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.426690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.426784 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.427304 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:39:35.427313 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:35.428721 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:35.430245 (+ 1524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:35.430251 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:35.430253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:35.430460 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:35.430747 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:39:35.430747 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:39:35.430747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:39:35.430894 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:39:35.431268 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:35.431276 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:35.431429 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 14:39:35.431539 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:39:35.431698 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260808 14:39:35.432322 9598 heartbeater.cc:347] Connected to a master server at 127.20.81.62:39459
I20260808 14:39:35.432428 9598 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:35.432621 9598 heartbeater.cc:511] Master 127.20.81.62:39459 requested a full tablet report, sending...
I20260808 14:39:35.433003 9103 ts_manager.cc:194] Registered new tserver with Master: 1371965a10514a4a8dbfe3acb0019723 (127.20.81.3:39501)
I20260808 14:39:35.433382 9103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.81.3@KRBTEST.COM'} at 127.20.81.3:53001
I20260808 14:39:35.442937 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:39:35.450421 9164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.444272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34374 (local address 127.20.81.62:39459)
0808 14:39:35.444332 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.444335 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.444448 (+ 113us) server_negotiation.cc:407] Connection header received
0808 14:39:35.444541 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.444542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.444575 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.444632 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:35.445216 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.445711 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.446449 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.446656 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.446731 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.447910 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:35.447911 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:35.447912 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:35.447919 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:35.449193 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:35.449538 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:35.449540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:35.449540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:35.449600 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:35.449821 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:35.449822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:35.449822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:35.449974 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:35.450089 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.450237 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.450319 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:39:35.451900 9103 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:39:35.453544 9103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:39:35.459884 9609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.455753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:45017 (local address 127.0.0.1:49416)
0808 14:39:35.455917 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.455957 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:35.456020 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:35.456543 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:35.456564 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:35.456567 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:35.456634 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.456636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.457586 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.457588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.458711 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.458714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.459584 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.459585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.459668 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.459682 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:39:35.459757 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:39:35.459810 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":76,"threads_started":1}
I20260808 14:39:35.459896 9613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.455956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49416 (local address 127.20.81.2:45017)
0808 14:39:35.456259 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.456263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.456271 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:39:35.456304 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.456305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.456318 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.456408 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:35.456755 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.457491 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.458818 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.459494 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.459584 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.459654 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.459773 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.459813 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":79,"threads_started":1}
I20260808 14:39:35.460402 9612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.455753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39501 (local address 127.0.0.1:49852)
0808 14:39:35.456082 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.456093 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:35.456149 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:35.456642 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:35.456642 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:35.456644 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:35.456679 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.456680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.458061 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.458062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.459047 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.459049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.460120 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.460121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.460202 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.460206 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:35.460265 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:39:35.460310 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":3,"thread_start_us":61,"threads_started":1}
I20260808 14:39:35.460496 9610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.455958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:42797 (local address 127.0.0.1:59134)
0808 14:39:35.456155 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.456165 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:35.456207 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:35.456602 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:35.456603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:35.456606 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:35.456677 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.456679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.458085 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.458086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.459119 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.459122 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.460183 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.460184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.460273 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.460278 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:39:35.460314 (+ 36us) client_negotiation.cc:240] Negotiation successful
0808 14:39:35.460352 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":1,"thread_start_us":74,"threads_started":1}
I20260808 14:39:35.460425 9611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.455858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49852 (local address 127.20.81.3:39501)
0808 14:39:35.456437 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.456441 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.456450 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:35.456488 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.456490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.456518 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.456757 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:35.456833 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.457934 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.459133 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.459859 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.460116 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.460181 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.460290 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.460335 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":93,"threads_started":1}
I20260808 14:39:35.460667 9383 tablet_service.cc:1467] Processing CreateTablet for tablet df890e75230748909c88d3f93d661036 (DEFAULT_TABLE table=test-table [id=626f24c6f9a441dda9d46ee6db025827]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:35.460846 9615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.456210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59134 (local address 127.20.81.1:42797)
0808 14:39:35.456382 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.456388 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.456398 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:39:35.456442 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.456444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.456461 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.456758 (+ 297us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:35.456834 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.457959 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.459220 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.459909 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.460615 (+ 706us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.460687 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.460713 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.460759 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260808 14:39:35.461087 9383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df890e75230748909c88d3f93d661036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:35.461400 9239 tablet_service.cc:1467] Processing CreateTablet for tablet df890e75230748909c88d3f93d661036 (DEFAULT_TABLE table=test-table [id=626f24c6f9a441dda9d46ee6db025827]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:35.461699 9239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df890e75230748909c88d3f93d661036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:35.463865 9616 tablet_bootstrap.cc:492] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: Bootstrap starting.
I20260808 14:39:35.464682 9616 tablet_bootstrap.cc:654] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:35.464648 9527 tablet_service.cc:1467] Processing CreateTablet for tablet df890e75230748909c88d3f93d661036 (DEFAULT_TABLE table=test-table [id=626f24c6f9a441dda9d46ee6db025827]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:35.464835 9617 tablet_bootstrap.cc:492] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d: Bootstrap starting.
I20260808 14:39:35.465016 9527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df890e75230748909c88d3f93d661036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:35.465328 9616 log.cc:824] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:35.465464 9617 tablet_bootstrap.cc:654] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:35.466053 9616 tablet_bootstrap.cc:492] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: No bootstrap required, opened a new log
I20260808 14:39:35.466037 9617 log.cc:824] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:35.466140 9616 ts_tablet_manager.cc:1397] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:39:35.466833 9617 tablet_bootstrap.cc:492] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d: No bootstrap required, opened a new log
I20260808 14:39:35.466907 9617 ts_tablet_manager.cc:1397] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:39:35.467707 9616 raft_consensus.cc:348] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } }
I20260808 14:39:35.467880 9616 raft_consensus.cc:374] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:35.467926 9616 raft_consensus.cc:729] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abc6a555b4424c35901e586520d2f3bc, State: Initialized, Role: FOLLOWER
I20260808 14:39:35.468044 9616 consensus_queue.cc:260] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } }
I20260808 14:39:35.468329 9616 ts_tablet_manager.cc:1428] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:39:35.468329 9454 heartbeater.cc:503] Master 127.20.81.62:39459 was elected leader, sending a full tablet report...
I20260808 14:39:35.468803 9622 tablet_bootstrap.cc:492] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: Bootstrap starting.
I20260808 14:39:35.469031 9617 raft_consensus.cc:348] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } }
I20260808 14:39:35.469230 9617 raft_consensus.cc:374] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:35.469267 9617 raft_consensus.cc:729] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bd364d326341e9ad737e4e857d848d, State: Initialized, Role: FOLLOWER
I20260808 14:39:35.469395 9617 consensus_queue.cc:260] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } }
I20260808 14:39:35.469473 9622 tablet_bootstrap.cc:654] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:35.469713 9617 ts_tablet_manager.cc:1428] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:39:35.469739 9312 heartbeater.cc:503] Master 127.20.81.62:39459 was elected leader, sending a full tablet report...
I20260808 14:39:35.470057 9622 log.cc:824] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:35.470917 9622 tablet_bootstrap.cc:492] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: No bootstrap required, opened a new log
I20260808 14:39:35.471005 9622 ts_tablet_manager.cc:1397] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:39:35.472272 9622 raft_consensus.cc:348] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } }
I20260808 14:39:35.472496 9622 raft_consensus.cc:374] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:35.472541 9622 raft_consensus.cc:729] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1371965a10514a4a8dbfe3acb0019723, State: Initialized, Role: FOLLOWER
I20260808 14:39:35.472671 9622 consensus_queue.cc:260] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } }
I20260808 14:39:35.472927 9622 ts_tablet_manager.cc:1428] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:39:35.472960 9598 heartbeater.cc:503] Master 127.20.81.62:39459 was elected leader, sending a full tablet report...
W20260808 14:39:35.512676 9455 tablet.cc:2369] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:39:35.524814 9623 raft_consensus.cc:482] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:35.524938 9623 raft_consensus.cc:504] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } }
I20260808 14:39:35.525393 9623 leader_election.cc:288] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abc6a555b4424c35901e586520d2f3bc (127.20.81.2:45017), 1371965a10514a4a8dbfe3acb0019723 (127.20.81.3:39501)
I20260808 14:39:35.528230 9314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.525573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:45017 (local address 127.20.81.1:37455)
0808 14:39:35.525665 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.525678 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:35.525727 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:35.525883 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:35.525884 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:35.525886 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:35.525968 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.525969 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.526611 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.526612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.527360 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.527363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.527956 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.527958 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.528044 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.528047 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:35.528116 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:39:35.528165 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 14:39:35.528230 9613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.525692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:37455 (local address 127.20.81.2:45017)
0808 14:39:35.525736 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.525738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.525764 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:39:35.525794 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.525795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.525812 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.525877 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:35.526044 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.526524 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.527462 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.527866 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.527956 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.527968 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.528123 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.528160 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:39:35.528424 9611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.525683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:42687 (local address 127.20.81.3:39501)
0808 14:39:35.525735 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.525737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.525908 (+ 171us) server_negotiation.cc:407] Connection header received
0808 14:39:35.526000 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.526000 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.526013 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.526088 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:35.526249 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.526727 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.527650 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.528034 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.528119 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.528130 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.528285 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.528333 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:39:35.528570 9405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df890e75230748909c88d3f93d661036" candidate_uuid: "78bd364d326341e9ad737e4e857d848d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abc6a555b4424c35901e586520d2f3bc" is_pre_election: true
I20260808 14:39:35.528622 9626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.525577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39501 (local address 127.20.81.1:42687)
0808 14:39:35.525826 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.525838 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:35.525924 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:35.526091 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:35.526092 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:35.526094 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:35.526178 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.526179 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.526816 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.526818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.527549 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.527550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.528124 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.528125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.528200 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.528204 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:35.528266 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 14:39:35.528449 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":66,"thread_start_us":131,"threads_started":1}
I20260808 14:39:35.528741 9405 raft_consensus.cc:2454] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bd364d326341e9ad737e4e857d848d in term 0.
I20260808 14:39:35.528972 9190 leader_election.cc:302] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bd364d326341e9ad737e4e857d848d, abc6a555b4424c35901e586520d2f3bc; no voters:
I20260808 14:39:35.529062 9549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df890e75230748909c88d3f93d661036" candidate_uuid: "78bd364d326341e9ad737e4e857d848d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1371965a10514a4a8dbfe3acb0019723" is_pre_election: true
I20260808 14:39:35.529117 9623 raft_consensus.cc:2781] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:39:35.529167 9623 raft_consensus.cc:482] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:39:35.529217 9623 raft_consensus.cc:3037] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:35.529227 9549 raft_consensus.cc:2454] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bd364d326341e9ad737e4e857d848d in term 0.
I20260808 14:39:35.529982 9623 raft_consensus.cc:504] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } }
I20260808 14:39:35.530129 9623 leader_election.cc:288] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [CANDIDATE]: Term 1 election: Requested vote from peers abc6a555b4424c35901e586520d2f3bc (127.20.81.2:45017), 1371965a10514a4a8dbfe3acb0019723 (127.20.81.3:39501)
I20260808 14:39:35.530275 9549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df890e75230748909c88d3f93d661036" candidate_uuid: "78bd364d326341e9ad737e4e857d848d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1371965a10514a4a8dbfe3acb0019723"
I20260808 14:39:35.530292 9405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df890e75230748909c88d3f93d661036" candidate_uuid: "78bd364d326341e9ad737e4e857d848d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abc6a555b4424c35901e586520d2f3bc"
I20260808 14:39:35.530369 9405 raft_consensus.cc:3037] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:35.530373 9549 raft_consensus.cc:3037] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:35.531121 9549 raft_consensus.cc:2454] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bd364d326341e9ad737e4e857d848d in term 1.
I20260808 14:39:35.531150 9405 raft_consensus.cc:2454] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bd364d326341e9ad737e4e857d848d in term 1.
I20260808 14:39:35.531302 9191 leader_election.cc:302] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1371965a10514a4a8dbfe3acb0019723, 78bd364d326341e9ad737e4e857d848d; no voters:
I20260808 14:39:35.531395 9623 raft_consensus.cc:2781] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:35.531558 9623 raft_consensus.cc:686] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [term 1 LEADER]: Becoming Leader. State: Replica: 78bd364d326341e9ad737e4e857d848d, State: Running, Role: LEADER
I20260808 14:39:35.531669 9623 consensus_queue.cc:237] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } }
I20260808 14:39:35.532532 9103 catalog_manager.cc:5495] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d reported cstate change: term changed from 0 to 1, leader changed from <none> to 78bd364d326341e9ad737e4e857d848d (127.20.81.1). New cstate: current_term: 1 leader_uuid: "78bd364d326341e9ad737e4e857d848d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78bd364d326341e9ad737e4e857d848d" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260808 14:39:35.556645 9615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.554143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59136 (local address 127.20.81.1:42797)
0808 14:39:35.554200 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.554202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.554211 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:35.554261 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.554262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.554283 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.554357 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:39:35.554563 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.555039 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.555814 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.556011 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.556090 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.556273 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:39:35.556373 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:39:35.556468 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.556489 (+ 21us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.556509 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:39:35.558542 9405 raft_consensus.cc:1261] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [term 1 FOLLOWER]: Refusing update from remote peer 78bd364d326341e9ad737e4e857d848d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:35.558542 9549 raft_consensus.cc:1261] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [term 1 FOLLOWER]: Refusing update from remote peer 78bd364d326341e9ad737e4e857d848d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:35.558961 9623 consensus_queue.cc:1035] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1371965a10514a4a8dbfe3acb0019723" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:35.559103 9628 consensus_queue.cc:1035] T df890e75230748909c88d3f93d661036 P 78bd364d326341e9ad737e4e857d848d [LEADER]: Connected to new peer: Peer: permanent_uuid: "abc6a555b4424c35901e586520d2f3bc" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:35.561870 9634 mvcc.cc:205] Tried to move back new op lower bound from 7316275099884699648 to 7316275099778453504. Current Snapshot: MvccSnapshot[applied={T|T < 7316275099884699648 or (T in {7316275099884699648})}]
I20260808 14:39:35.563696 9104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:35.563803 9104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:35.564653 9104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cb04912896fe4ad19c0bb4ec6ec68f48: Sending DeleteTablet for 3 replicas of tablet df890e75230748909c88d3f93d661036
I20260808 14:39:35.565025 9239 tablet_service.cc:1514] Processing DeleteTablet for tablet df890e75230748909c88d3f93d661036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:35 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:59134
I20260808 14:39:35.565039 9527 tablet_service.cc:1514] Processing DeleteTablet for tablet df890e75230748909c88d3f93d661036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:35 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:49852
I20260808 14:39:35.565071 9383 tablet_service.cc:1514] Processing DeleteTablet for tablet df890e75230748909c88d3f93d661036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:35 UTC) from {username='kudu', principal='kudu/127.20.81.62@KRBTEST.COM'} at 127.0.0.1:49416
I20260808 14:39:35.565414 9646 tablet_replica.cc:330] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: stopping tablet replica
I20260808 14:39:35.565465 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 9172
I20260808 14:39:35.565518 9646 raft_consensus.cc:2229] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:35.565616 9646 raft_consensus.cc:2258] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:35.566119 9646 ts_tablet_manager.cc:1905] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:35.567569 9644 tablet_replica.cc:330] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: stopping tablet replica
I20260808 14:39:35.567673 9644 raft_consensus.cc:2229] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:35.567692 9646 ts_tablet_manager.cc:1918] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:35.567761 9644 raft_consensus.cc:2258] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:35.567850 9646 log.cc:1196] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/df890e75230748909c88d3f93d661036
I20260808 14:39:35.568179 9646 ts_tablet_manager.cc:1939] T df890e75230748909c88d3f93d661036 P abc6a555b4424c35901e586520d2f3bc: Deleting consensus metadata
I20260808 14:39:35.568208 9644 ts_tablet_manager.cc:1905] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:35.568635 9089 catalog_manager.cc:4841] TS abc6a555b4424c35901e586520d2f3bc (127.20.81.2:45017): tablet df890e75230748909c88d3f93d661036 (table test-table [id=626f24c6f9a441dda9d46ee6db025827]) successfully deleted
I20260808 14:39:35.569916 9644 ts_tablet_manager.cc:1918] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:35.569989 9644 log.cc:1196] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/df890e75230748909c88d3f93d661036
I20260808 14:39:35.570242 9644 ts_tablet_manager.cc:1939] T df890e75230748909c88d3f93d661036 P 1371965a10514a4a8dbfe3acb0019723: Deleting consensus metadata
I20260808 14:39:35.570688 9090 catalog_manager.cc:4841] TS 1371965a10514a4a8dbfe3acb0019723 (127.20.81.3:39501): tablet df890e75230748909c88d3f93d661036 (table test-table [id=626f24c6f9a441dda9d46ee6db025827]) successfully deleted
W20260808 14:39:35.574040 9089 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:42797 (error 108)
I20260808 14:39:35.574573 9610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.574457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:42797 (local address 127.0.0.1:59152)
0808 14:39:35.574510 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.574547 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:42797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:39:35.574704 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 9317
W20260808 14:39:35.574715 9089 catalog_manager.cc:4584] TS 78bd364d326341e9ad737e4e857d848d (127.20.81.1:42797): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet df890e75230748909c88d3f93d661036: Network error: Client connection negotiation failed: client connection to 127.20.81.1:42797: connect: Connection refused (error 111)
I20260808 14:39:35.580490 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 9459
I20260808 14:39:35.589147 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 9068
2026-08-08T14:39:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2020 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T14:39:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:35Z Disabled control of system clock
I20260808 14:39:35.620031 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:41755
--webserver_interface=127.20.81.62
--webserver_port=0
--builtin_ntp_servers=127.20.81.20:35805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:41755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:39:35.701828 9653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:35.702042 9653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:35.702064 9653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:35.703207 9653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:35.703265 9653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:35.703279 9653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:35.703290 9653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:35.703303 9653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:35.704772 9653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:35805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:41755
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:41755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:35.705030 9653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:35.705327 9653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:39:35.710172 9653 server_base.cc:1034] running on GCE node
W20260808 14:39:35.710181 9658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.710186 9660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.710311 9662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:35.710608 9653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:35.710891 9653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:35.712054 9653 hybrid_clock.cc:648] HybridClock initialized: now 1786199975712042 us; error 28 us; skew 500 ppm
I20260808 14:39:35.713343 9653 webserver.cc:460] Webserver started at http://127.20.81.62:44251/ using document root <none> and password file <none>
I20260808 14:39:35.713624 9653 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:35.713696 9653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:35.713850 9653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:35.715022 9653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "bc37301476e84108be9677912bd94e0d"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "3994b62ca7a5473c5a68aca38bb23c39"
server_key_iv: "6d4358698114a62f1507af5297bd2bde"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.715510 9653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "bc37301476e84108be9677912bd94e0d"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "3994b62ca7a5473c5a68aca38bb23c39"
server_key_iv: "6d4358698114a62f1507af5297bd2bde"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.716959 9653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:35.717746 9669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.717964 9653 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:35.718068 9653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "bc37301476e84108be9677912bd94e0d"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "3994b62ca7a5473c5a68aca38bb23c39"
server_key_iv: "6d4358698114a62f1507af5297bd2bde"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.718151 9653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:35.746170 9653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:35.746532 9653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:35.746691 9653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:35.750828 9653 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:41755
I20260808 14:39:35.750867 9725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:41755 every 8 connection(s)
I20260808 14:39:35.751243 9653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:35.752208 9726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:35.754555 9726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d: Bootstrap starting.
I20260808 14:39:35.754948 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 9653
I20260808 14:39:35.755079 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:35.755303 20804 external_mini_cluster.cc:1428] Setting key 13be9c068d8f6d1670428689a1981613
I20260808 14:39:35.755317 9726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:35.755687 9726 log.cc:824] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:35.756435 9726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d: No bootstrap required, opened a new log
I20260808 14:39:35.758260 9726 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc37301476e84108be9677912bd94e0d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41755 } }
I20260808 14:39:35.758419 9726 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:35.758467 9726 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc37301476e84108be9677912bd94e0d, State: Initialized, Role: FOLLOWER
I20260808 14:39:35.758628 9726 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc37301476e84108be9677912bd94e0d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41755 } }
I20260808 14:39:35.758710 9726 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:35.758752 9726 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:35.758803 9726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:35.759342 9726 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc37301476e84108be9677912bd94e0d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41755 } }
I20260808 14:39:35.759462 9726 leader_election.cc:302] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc37301476e84108be9677912bd94e0d; no voters:
I20260808 14:39:35.759682 9726 leader_election.cc:288] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:35.759714 9732 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:35.759853 9732 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [term 1 LEADER]: Becoming Leader. State: Replica: bc37301476e84108be9677912bd94e0d, State: Running, Role: LEADER
I20260808 14:39:35.759944 9732 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc37301476e84108be9677912bd94e0d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41755 } }
I20260808 14:39:35.759995 9726 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:35.760303 9732 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc37301476e84108be9677912bd94e0d. Latest consensus state: current_term: 1 leader_uuid: "bc37301476e84108be9677912bd94e0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc37301476e84108be9677912bd94e0d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41755 } } }
I20260808 14:39:35.760386 9732 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:35.760828 9734 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc37301476e84108be9677912bd94e0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc37301476e84108be9677912bd94e0d" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 41755 } } }
I20260808 14:39:35.760967 9734 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:35.761099 9739 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:35.761432 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.755856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56898 (local address 127.20.81.62:41755)
0808 14:39:35.756084 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.756093 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.756129 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:39:35.756686 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.756693 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.756753 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.756906 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:35.757139 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.758016 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.758968 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.759374 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.759512 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.760302 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:35.760306 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:35.760306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:35.760523 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:35.760594 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:35.760612 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:35.760687 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.761072 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.761158 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":98,"threads_started":1}
I20260808 14:39:35.762123 9739 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:35.763664 9739 catalog_manager.cc:1347] Generated new cluster ID: bf598ddb22fe4d17886bd0927eb6ca98
I20260808 14:39:35.763716 9739 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:35.771960 9739 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:35.772681 9739 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:35.783172 9739 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d: Generated new TSK 0
I20260808 14:39:35.783370 9739 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:35.792694 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.1:0
--local_ip_for_outbound_sockets=127.20.81.1
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41755
--builtin_ntp_servers=127.20.81.20:35805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:39:35.885919 9752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:35.886300 9752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:35.886358 9752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:35.888038 9752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:35.888110 9752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:35.888155 9752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.1
I20260808 14:39:35.889807 9752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:35805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.81.1
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.1
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:35.890089 9752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:35.890405 9752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:35.895483 9758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.895524 9761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:35.895669 9759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:35.896170 9752 server_base.cc:1034] running on GCE node
I20260808 14:39:35.896377 9752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:35.896668 9752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:35.897850 9752 hybrid_clock.cc:648] HybridClock initialized: now 1786199975897832 us; error 34 us; skew 500 ppm
I20260808 14:39:35.899245 9752 webserver.cc:460] Webserver started at http://127.20.81.1:45607/ using document root <none> and password file <none>
I20260808 14:39:35.899539 9752 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:35.899609 9752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:35.899768 9752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:35.900934 9752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/data/instance:
uuid: "3a6a3d8439164351b26cc33ee5aa2f6a"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "b59dc6886ba44d10a226180313014ced"
server_key_iv: "8b89d92cfd2c72f95c0de373b60c7fcd"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.901294 9752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance:
uuid: "3a6a3d8439164351b26cc33ee5aa2f6a"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "b59dc6886ba44d10a226180313014ced"
server_key_iv: "8b89d92cfd2c72f95c0de373b60c7fcd"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.902652 9752 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:39:35.903450 9770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.903671 9752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:35.903772 9752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/wal
uuid: "3a6a3d8439164351b26cc33ee5aa2f6a"
format_stamp: "Formatted at 2026-08-08 14:39:35 on dist-test-slave-8n49"
server_key: "b59dc6886ba44d10a226180313014ced"
server_key_iv: "8b89d92cfd2c72f95c0de373b60c7fcd"
server_key_version: "encryptionkey@0"
I20260808 14:39:35.903855 9752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:35.927507 9752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:35.927856 9752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:35.928020 9752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:35.928264 9752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:35.928639 9752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:35.928696 9752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.928732 9752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:35.928781 9752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:35.934741 9752 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.1:46509
I20260808 14:39:35.934790 9894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.1:46509 every 8 connection(s)
I20260808 14:39:35.935132 9752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/data/info.pb
I20260808 14:39:35.940089 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 9752
I20260808 14:39:35.940207 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-0/wal/instance
I20260808 14:39:35.940488 20804 external_mini_cluster.cc:1428] Setting key 9fb7eca2418e673a880c3229392b66c7
I20260808 14:39:35.941066 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.935845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:44787 (local address 127.20.81.62:41755)
0808 14:39:35.935923 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:35.935926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:35.936174 (+ 248us) server_negotiation.cc:407] Connection header received
0808 14:39:35.936809 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:35.936811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:35.936821 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:35.936875 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:35.937535 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.938214 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.939357 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.939556 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.939623 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.940747 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:35.940749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:35.940750 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:35.940756 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:35.940775 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:35.940780 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:35.940841 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:35.940958 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:39:35.940986 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:39:35.941322 9897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:35.935846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41755 (local address 127.20.81.1:44787)
0808 14:39:35.936058 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:35.936094 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:35.936711 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:35.936930 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:35.936933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:35.936942 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:35.937457 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.937461 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.938345 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.938346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.939250 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:35.939252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:35.939679 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:35.939680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:35.939803 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:35.940537 (+ 734us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:39:35.940538 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:35.940606 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:39:35.940640 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:35.940860 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:35.940867 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:35.940870 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:35.940949 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:39:35.941068 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":97,"threads_started":1}
I20260808 14:39:35.941668 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.2:0
--local_ip_for_outbound_sockets=127.20.81.2
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41755
--builtin_ntp_servers=127.20.81.20:35805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:39:35.941757 9895 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41755
I20260808 14:39:35.941843 9895 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:35.942030 9895 heartbeater.cc:511] Master 127.20.81.62:41755 requested a full tablet report, sending...
I20260808 14:39:35.942548 9687 ts_manager.cc:194] Registered new tserver with Master: 3a6a3d8439164351b26cc33ee5aa2f6a (127.20.81.1:46509)
I20260808 14:39:35.943177 9687 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.1:44787
W20260808 14:39:36.024952 9898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:36.025158 9898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:36.025180 9898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:36.026350 9898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:36.026391 9898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:36.026415 9898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.2
I20260808 14:39:36.027767 9898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:35805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.81.2
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.2
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:36.028031 9898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:36.028337 9898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:36.033308 9904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:36.033316 9905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:36.033342 9907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:36.033639 9898 server_base.cc:1034] running on GCE node
I20260808 14:39:36.033879 9898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:36.034127 9898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:36.035295 9898 hybrid_clock.cc:648] HybridClock initialized: now 1786199976035289 us; error 36 us; skew 500 ppm
I20260808 14:39:36.036514 9898 webserver.cc:460] Webserver started at http://127.20.81.2:45877/ using document root <none> and password file <none>
I20260808 14:39:36.036804 9898 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:36.036878 9898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:36.037056 9898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:36.038116 9898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/data/instance:
uuid: "114380fa47564d91a73cdee35ccac668"
format_stamp: "Formatted at 2026-08-08 14:39:36 on dist-test-slave-8n49"
server_key: "440e5b5db0aaee020abd4b6b89702bbc"
server_key_iv: "4c5ed1c0348c7ac1e3f38bd34fc7741a"
server_key_version: "encryptionkey@0"
I20260808 14:39:36.038491 9898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance:
uuid: "114380fa47564d91a73cdee35ccac668"
format_stamp: "Formatted at 2026-08-08 14:39:36 on dist-test-slave-8n49"
server_key: "440e5b5db0aaee020abd4b6b89702bbc"
server_key_iv: "4c5ed1c0348c7ac1e3f38bd34fc7741a"
server_key_version: "encryptionkey@0"
I20260808 14:39:36.039793 9898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:39:36.040520 9913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:36.040701 9898 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:39:36.040809 9898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/wal
uuid: "114380fa47564d91a73cdee35ccac668"
format_stamp: "Formatted at 2026-08-08 14:39:36 on dist-test-slave-8n49"
server_key: "440e5b5db0aaee020abd4b6b89702bbc"
server_key_iv: "4c5ed1c0348c7ac1e3f38bd34fc7741a"
server_key_version: "encryptionkey@0"
I20260808 14:39:36.040887 9898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:36.060637 9898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:36.060971 9898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:36.061122 9898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:36.061380 9898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:36.061743 9898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:36.061798 9898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:36.061836 9898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:36.061862 9898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:36.067936 9898 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.2:39819
I20260808 14:39:36.067986 10036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.2:39819 every 8 connection(s)
I20260808 14:39:36.068332 9898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/data/info.pb
I20260808 14:39:36.073328 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.069090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.2:59527 (local address 127.20.81.62:41755)
0808 14:39:36.069163 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:36.069165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:36.069359 (+ 194us) server_negotiation.cc:407] Connection header received
0808 14:39:36.069865 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:36.069866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:36.069877 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:36.069931 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:36.070586 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.071074 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.071991 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.072173 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.072222 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.073098 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:36.073099 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:36.073099 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:36.073103 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:36.073116 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:36.073119 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:36.073162 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:36.073247 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:39:36.073268 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:39:36.073576 10039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.069074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41755 (local address 127.20.81.2:59527)
0808 14:39:36.069255 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:36.069291 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:36.069774 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:36.070006 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:36.070009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:36.070022 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:36.070514 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.070519 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.071156 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.071157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.071916 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.071918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.072251 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.072252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.072364 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.072959 (+ 595us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:39:36.072960 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:36.072994 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:39:36.073024 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:36.073176 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:36.073181 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:36.073184 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:36.073237 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:39:36.073316 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260808 14:39:36.074146 10037 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41755
I20260808 14:39:36.074245 10037 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:36.074425 10037 heartbeater.cc:511] Master 127.20.81.62:41755 requested a full tablet report, sending...
I20260808 14:39:36.074847 9687 ts_manager.cc:194] Registered new tserver with Master: 114380fa47564d91a73cdee35ccac668 (127.20.81.2:39819)
I20260808 14:39:36.075237 9687 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.2:59527
I20260808 14:39:36.077562 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 9898
I20260808 14:39:36.077682 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/wal/instance
I20260808 14:39:36.077893 20804 external_mini_cluster.cc:1428] Setting key 6e2471779a80c42820976141a35a0196
I20260808 14:39:36.078785 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.81.3:0
--local_ip_for_outbound_sockets=127.20.81.3
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41755
--builtin_ntp_servers=127.20.81.20:35805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:39:36.161384 10040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:36.161661 10040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:36.161695 10040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:36.162806 10040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:36.162866 10040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:36.162909 10040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.81.3
I20260808 14:39:36.164247 10040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:35805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.81.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.81.3
--webserver_port=0
--tserver_master_addrs=127.20.81.62:41755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.81.3
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:36.164507 10040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:36.164824 10040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:39:36.169867 10040 server_base.cc:1034] running on GCE node
W20260808 14:39:36.169894 10047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:36.169852 10049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:36.169843 10046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:36.170272 10040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:36.170550 10040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:36.171692 10040 hybrid_clock.cc:648] HybridClock initialized: now 1786199976171680 us; error 26 us; skew 500 ppm
I20260808 14:39:36.173029 10040 webserver.cc:460] Webserver started at http://127.20.81.3:45149/ using document root <none> and password file <none>
I20260808 14:39:36.173276 10040 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:36.173322 10040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:36.173517 10040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:36.174607 10040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/data/instance:
uuid: "b17c0852d2314ac49b28ea0076997c0c"
format_stamp: "Formatted at 2026-08-08 14:39:36 on dist-test-slave-8n49"
server_key: "3eadba8360cacf562b5d926ce6c35b14"
server_key_iv: "2837ed19fcc19ea4f08a9a323028f705"
server_key_version: "encryptionkey@0"
I20260808 14:39:36.174973 10040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance:
uuid: "b17c0852d2314ac49b28ea0076997c0c"
format_stamp: "Formatted at 2026-08-08 14:39:36 on dist-test-slave-8n49"
server_key: "3eadba8360cacf562b5d926ce6c35b14"
server_key_iv: "2837ed19fcc19ea4f08a9a323028f705"
server_key_version: "encryptionkey@0"
I20260808 14:39:36.176260 10040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:39:36.177100 10055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:36.177294 10040 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:39:36.177373 10040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/wal
uuid: "b17c0852d2314ac49b28ea0076997c0c"
format_stamp: "Formatted at 2026-08-08 14:39:36 on dist-test-slave-8n49"
server_key: "3eadba8360cacf562b5d926ce6c35b14"
server_key_iv: "2837ed19fcc19ea4f08a9a323028f705"
server_key_version: "encryptionkey@0"
I20260808 14:39:36.177477 10040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:36.189188 10040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:36.189479 10040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:36.189627 10040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:36.189844 10040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:39:36.190186 10040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:39:36.190240 10040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:36.190274 10040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:39:36.190301 10040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:36.196105 10040 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.3:39925
I20260808 14:39:36.196148 10181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.3:39925 every 8 connection(s)
I20260808 14:39:36.196475 10040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/data/info.pb
I20260808 14:39:36.201817 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.197211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.3:48375 (local address 127.20.81.62:41755)
0808 14:39:36.197258 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:36.197260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:36.197534 (+ 274us) server_negotiation.cc:407] Connection header received
0808 14:39:36.198090 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:36.198092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:36.198106 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:36.198164 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:36.198868 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.199361 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.200420 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.200640 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.200723 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.201522 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:36.201525 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:36.201525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:36.201535 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:36.201548 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:36.201552 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:36.201615 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:36.201710 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 14:39:36.201738 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:39:36.202049 10184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.197200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:41755 (local address 127.20.81.3:48375)
0808 14:39:36.197414 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:36.197446 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:36.197972 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:36.198248 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:36.198258 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:36.198267 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:39:36.198763 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.198767 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.199463 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.199465 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.200323 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.200326 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.200730 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.200732 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.200861 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.201328 (+ 467us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:39:36.201329 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:39:36.201357 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:39:36.201380 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:39:36.201617 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:39:36.201623 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:39:36.201626 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:39:36.201712 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:39:36.201811 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":97,"threads_started":1}
I20260808 14:39:36.202581 10182 heartbeater.cc:347] Connected to a master server at 127.20.81.62:41755
I20260808 14:39:36.202677 10182 heartbeater.cc:464] Registering TS with master...
I20260808 14:39:36.202816 10182 heartbeater.cc:511] Master 127.20.81.62:41755 requested a full tablet report, sending...
I20260808 14:39:36.203218 9687 ts_manager.cc:194] Registered new tserver with Master: b17c0852d2314ac49b28ea0076997c0c (127.20.81.3:39925)
I20260808 14:39:36.203608 9687 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.81.3:48375
I20260808 14:39:36.203959 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 10040
I20260808 14:39:36.204082 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/wal/instance
I20260808 14:39:36.204306 20804 external_mini_cluster.cc:1428] Setting key 148790a94ae0e57c0177b846cce9713e
I20260808 14:39:36.205168 20804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:39:36.209487 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.206554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56910 (local address 127.20.81.62:41755)
0808 14:39:36.206627 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:36.206629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:36.206740 (+ 111us) server_negotiation.cc:407] Connection header received
0808 14:39:36.206818 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:36.206819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:36.206829 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:36.206898 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:36.207101 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.207569 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.208311 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.208507 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.208639 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.209238 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:36.209239 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:36.209240 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:36.209244 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:36.209257 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:36.209261 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:36.209314 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:36.209378 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 14:39:36.209405 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:39:36.210848 9687 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:39:36.212349 9687 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:39:36.218698 10194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.214797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:46509 (local address 127.0.0.1:35838)
0808 14:39:36.215152 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:36.215163 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:36.215212 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:36.215481 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:36.215482 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:36.215484 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:36.215525 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.215526 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.216779 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.216780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.217740 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.217743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.218402 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.218403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.218487 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.218500 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:39:36.218575 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:39:36.218627 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":69,"threads_started":1}
I20260808 14:39:36.218712 10195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.214879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35838 (local address 127.20.81.1:46509)
0808 14:39:36.215093 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:36.215097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:36.215270 (+ 173us) server_negotiation.cc:407] Connection header received
0808 14:39:36.215314 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:36.215317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:36.215334 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:36.215408 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:36.215608 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.216682 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.217810 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.218313 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.218401 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.218496 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:36.218589 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 14:39:36.218627 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":104,"threads_started":1}
I20260808 14:39:36.218958 10190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.214554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:39819 (local address 127.0.0.1:54392)
0808 14:39:36.214859 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:36.214903 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:36.214971 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:36.215351 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:36.215351 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:36.215353 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:36.215385 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.215385 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.216315 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.216316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.217704 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.217706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.218713 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.218714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.218779 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.218783 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:36.218841 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:39:36.218892 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":4,"thread_start_us":72,"threads_started":1}
I20260808 14:39:36.219226 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.214666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54392 (local address 127.20.81.2:39819)
0808 14:39:36.214933 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:36.214938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:36.214953 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:39:36.215098 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:36.215101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:36.215123 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:36.215212 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:36.215459 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.216199 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.217809 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.218517 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.218590 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.218673 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:36.219099 (+ 426us) server_negotiation.cc:299] Negotiation successful
0808 14:39:36.219148 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":89,"threads_started":1}
I20260808 14:39:36.219237 10191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.214581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39925 (local address 127.0.0.1:53696)
0808 14:39:36.214922 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:36.214931 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:36.214971 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:36.215214 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:36.215217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:36.215219 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:36.215282 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.215284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.216625 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.216626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.217703 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.217706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.218715 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.218715 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.219080 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.219084 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:36.219141 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:39:36.219176 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":1,"thread_start_us":85,"threads_started":1}
I20260808 14:39:36.219444 10193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.214677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53696 (local address 127.20.81.3:39925)
0808 14:39:36.215029 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:36.215033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:36.215042 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:36.215081 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:36.215083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:36.215099 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:36.215196 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:36.215371 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.216523 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.217809 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.218517 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.218591 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.218672 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:36.219335 (+ 663us) server_negotiation.cc:299] Negotiation successful
0808 14:39:36.219376 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":84,"threads_started":1}
I20260808 14:39:36.219451 9822 tablet_service.cc:1467] Processing CreateTablet for tablet b3a1a6ce048e4a6aaec4bf73ddec6059 (DEFAULT_TABLE table=test-table [id=e0b4f728049f49579ee4bc952542ed2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:36.219833 9822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3a1a6ce048e4a6aaec4bf73ddec6059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:36.219866 9964 tablet_service.cc:1467] Processing CreateTablet for tablet b3a1a6ce048e4a6aaec4bf73ddec6059 (DEFAULT_TABLE table=test-table [id=e0b4f728049f49579ee4bc952542ed2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:36.220209 9964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3a1a6ce048e4a6aaec4bf73ddec6059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:36.221199 10106 tablet_service.cc:1467] Processing CreateTablet for tablet b3a1a6ce048e4a6aaec4bf73ddec6059 (DEFAULT_TABLE table=test-table [id=e0b4f728049f49579ee4bc952542ed2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:39:36.221550 10106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3a1a6ce048e4a6aaec4bf73ddec6059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:36.223543 10196 tablet_bootstrap.cc:492] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: Bootstrap starting.
I20260808 14:39:36.224251 10196 tablet_bootstrap.cc:654] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:36.224259 10199 tablet_bootstrap.cc:492] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: Bootstrap starting.
I20260808 14:39:36.224259 10197 tablet_bootstrap.cc:492] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a: Bootstrap starting.
I20260808 14:39:36.224659 10196 log.cc:824] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:36.224959 10199 tablet_bootstrap.cc:654] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:36.224977 10197 tablet_bootstrap.cc:654] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:36.225303 10199 log.cc:824] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:36.225303 10197 log.cc:824] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:36.225401 10196 tablet_bootstrap.cc:492] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: No bootstrap required, opened a new log
I20260808 14:39:36.225476 10196 ts_tablet_manager.cc:1397] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:39:36.226099 10197 tablet_bootstrap.cc:492] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a: No bootstrap required, opened a new log
I20260808 14:39:36.226172 10197 ts_tablet_manager.cc:1397] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:39:36.226316 10199 tablet_bootstrap.cc:492] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: No bootstrap required, opened a new log
I20260808 14:39:36.226379 10199 ts_tablet_manager.cc:1397] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:39:36.227794 10196 raft_consensus.cc:348] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } }
I20260808 14:39:36.227952 10196 raft_consensus.cc:374] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:36.227996 10196 raft_consensus.cc:729] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114380fa47564d91a73cdee35ccac668, State: Initialized, Role: FOLLOWER
I20260808 14:39:36.228123 10196 consensus_queue.cc:260] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } }
I20260808 14:39:36.228403 10196 ts_tablet_manager.cc:1428] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:39:36.228576 10037 heartbeater.cc:503] Master 127.20.81.62:41755 was elected leader, sending a full tablet report...
I20260808 14:39:36.228845 10197 raft_consensus.cc:348] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } }
I20260808 14:39:36.229007 10197 raft_consensus.cc:374] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:36.229043 10197 raft_consensus.cc:729] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6a3d8439164351b26cc33ee5aa2f6a, State: Initialized, Role: FOLLOWER
I20260808 14:39:36.229153 10197 consensus_queue.cc:260] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } }
I20260808 14:39:36.229094 10199 raft_consensus.cc:348] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } }
I20260808 14:39:36.229229 10199 raft_consensus.cc:374] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:36.229266 10199 raft_consensus.cc:729] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b17c0852d2314ac49b28ea0076997c0c, State: Initialized, Role: FOLLOWER
I20260808 14:39:36.229399 10197 ts_tablet_manager.cc:1428] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260808 14:39:36.229372 10199 consensus_queue.cc:260] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } }
I20260808 14:39:36.229543 9895 heartbeater.cc:503] Master 127.20.81.62:41755 was elected leader, sending a full tablet report...
I20260808 14:39:36.229624 10199 ts_tablet_manager.cc:1428] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 14:39:36.229664 10182 heartbeater.cc:503] Master 127.20.81.62:41755 was elected leader, sending a full tablet report...
W20260808 14:39:36.319001 10038 tablet.cc:2369] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:39:36.424918 10204 raft_consensus.cc:482] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:39:36.425058 10204 raft_consensus.cc:504] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } }
I20260808 14:39:36.425449 10204 leader_election.cc:288] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114380fa47564d91a73cdee35ccac668 (127.20.81.2:39819), b17c0852d2314ac49b28ea0076997c0c (127.20.81.3:39925)
I20260808 14:39:36.428359 9897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.425670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.2:39819 (local address 127.20.81.1:37623)
0808 14:39:36.425749 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:36.425763 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:36.425813 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:36.425980 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:36.425981 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:36.425983 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:36.426072 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.426075 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.426773 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.426774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.427549 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.427551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.428090 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.428092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.428166 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.428170 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:36.428222 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:39:36.428264 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 14:39:36.428359 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.425740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:37623 (local address 127.20.81.2:39819)
0808 14:39:36.425790 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:36.425792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:36.425805 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:39:36.425885 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:36.425887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:36.425897 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:36.425958 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:36.426155 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.426687 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.427643 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.428007 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.428064 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.428073 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:36.428238 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 14:39:36.428279 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:39:36.428459 10193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.425793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.81.1:51519 (local address 127.20.81.3:39925)
0808 14:39:36.425838 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:36.425841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:36.425962 (+ 121us) server_negotiation.cc:407] Connection header received
0808 14:39:36.425998 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:36.425999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:36.426008 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:36.426070 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:39:36.426264 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.426711 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.427691 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.428078 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.428161 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.428171 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:36.428339 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 14:39:36.428383 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:39:36.428506 10206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.425710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.3:39925 (local address 127.20.81.1:51519)
0808 14:39:36.425862 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:36.425872 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:39:36.425947 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:39:36.426096 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:39:36.426097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:39:36.426099 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:39:36.426194 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.426196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.426820 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.426821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.427573 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:39:36.427574 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.428168 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.428169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:39:36.428257 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.428261 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:39:36.428319 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:39:36.428355 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":2,"thread_start_us":71,"threads_started":1}
I20260808 14:39:36.428787 9987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3a1a6ce048e4a6aaec4bf73ddec6059" candidate_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114380fa47564d91a73cdee35ccac668" is_pre_election: true
I20260808 14:39:36.428960 9987 raft_consensus.cc:2454] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a6a3d8439164351b26cc33ee5aa2f6a in term 0.
I20260808 14:39:36.428941 10128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3a1a6ce048e4a6aaec4bf73ddec6059" candidate_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17c0852d2314ac49b28ea0076997c0c" is_pre_election: true
I20260808 14:39:36.429111 10128 raft_consensus.cc:2454] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a6a3d8439164351b26cc33ee5aa2f6a in term 0.
I20260808 14:39:36.429250 9772 leader_election.cc:302] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114380fa47564d91a73cdee35ccac668, 3a6a3d8439164351b26cc33ee5aa2f6a; no voters:
I20260808 14:39:36.429430 10204 raft_consensus.cc:2781] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:39:36.429489 10204 raft_consensus.cc:482] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:39:36.429522 10204 raft_consensus.cc:3037] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:36.430253 10204 raft_consensus.cc:504] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } }
I20260808 14:39:36.430408 10204 leader_election.cc:288] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [CANDIDATE]: Term 1 election: Requested vote from peers 114380fa47564d91a73cdee35ccac668 (127.20.81.2:39819), b17c0852d2314ac49b28ea0076997c0c (127.20.81.3:39925)
I20260808 14:39:36.430545 9987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3a1a6ce048e4a6aaec4bf73ddec6059" candidate_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114380fa47564d91a73cdee35ccac668"
I20260808 14:39:36.430568 10128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3a1a6ce048e4a6aaec4bf73ddec6059" candidate_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17c0852d2314ac49b28ea0076997c0c"
I20260808 14:39:36.430626 9987 raft_consensus.cc:3037] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:36.430658 10128 raft_consensus.cc:3037] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:36.431360 9987 raft_consensus.cc:2454] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a6a3d8439164351b26cc33ee5aa2f6a in term 1.
I20260808 14:39:36.431454 10128 raft_consensus.cc:2454] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a6a3d8439164351b26cc33ee5aa2f6a in term 1.
I20260808 14:39:36.431545 9772 leader_election.cc:302] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114380fa47564d91a73cdee35ccac668, 3a6a3d8439164351b26cc33ee5aa2f6a; no voters:
I20260808 14:39:36.431632 10204 raft_consensus.cc:2781] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:36.431784 10204 raft_consensus.cc:686] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [term 1 LEADER]: Becoming Leader. State: Replica: 3a6a3d8439164351b26cc33ee5aa2f6a, State: Running, Role: LEADER
I20260808 14:39:36.431890 10204 consensus_queue.cc:237] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } }
I20260808 14:39:36.432830 9686 catalog_manager.cc:5495] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a6a3d8439164351b26cc33ee5aa2f6a (127.20.81.1). New cstate: current_term: 1 leader_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a6a3d8439164351b26cc33ee5aa2f6a" member_type: VOTER last_known_addr { host: "127.20.81.1" port: 46509 } health_report { overall_health: HEALTHY } } }
W20260808 14:39:36.435773 9896 tablet.cc:2369] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:39:36.445083 10195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.442790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37926 (local address 127.20.81.1:46509)
0808 14:39:36.442841 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:36.442843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:36.442851 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:39:36.442926 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:36.442927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:36.442943 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:36.443000 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:39:36.443100 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.443538 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.444334 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:36.444510 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:36.444620 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:36.444761 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:39:36.444854 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:39:36.444923 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:36.444959 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:39:36.444976 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:39:36.446801 9987 raft_consensus.cc:1261] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [term 1 FOLLOWER]: Refusing update from remote peer 3a6a3d8439164351b26cc33ee5aa2f6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:39:36.446801 10128 raft_consensus.cc:1261] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [term 1 FOLLOWER]: Refusing update from remote peer 3a6a3d8439164351b26cc33ee5aa2f6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260808 14:39:36.447005 10183 tablet.cc:2369] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:39:36.447165 10204 consensus_queue.cc:1035] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b17c0852d2314ac49b28ea0076997c0c" member_type: VOTER last_known_addr { host: "127.20.81.3" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:36.447286 10207 consensus_queue.cc:1035] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 3a6a3d8439164351b26cc33ee5aa2f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "114380fa47564d91a73cdee35ccac668" member_type: VOTER last_known_addr { host: "127.20.81.2" port: 39819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:39:36.449652 10210 mvcc.cc:205] Tried to move back new op lower bound from 7316275103523713024 to 7316275103465832448. Current Snapshot: MvccSnapshot[applied={T|T < 7316275103523713024}]
I20260808 14:39:36.452214 9685 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:36.452323 9685 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:39:36.453199 9685 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc37301476e84108be9677912bd94e0d: Sending DeleteTablet for 3 replicas of tablet b3a1a6ce048e4a6aaec4bf73ddec6059
I20260808 14:39:36.453586 9964 tablet_service.cc:1514] Processing DeleteTablet for tablet b3a1a6ce048e4a6aaec4bf73ddec6059 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:36 UTC) from {username='slave'} at 127.0.0.1:54392
I20260808 14:39:36.453655 10106 tablet_service.cc:1514] Processing DeleteTablet for tablet b3a1a6ce048e4a6aaec4bf73ddec6059 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:36 UTC) from {username='slave'} at 127.0.0.1:53696
I20260808 14:39:36.453828 9822 tablet_service.cc:1514] Processing DeleteTablet for tablet b3a1a6ce048e4a6aaec4bf73ddec6059 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:39:36 UTC) from {username='slave'} at 127.0.0.1:35838
I20260808 14:39:36.453905 10221 tablet_replica.cc:330] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: stopping tablet replica
I20260808 14:39:36.454018 10221 raft_consensus.cc:2229] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:36.454136 10221 raft_consensus.cc:2258] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:36.454337 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 9752
I20260808 14:39:36.454658 10221 ts_tablet_manager.cc:1905] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:36.456837 10221 ts_tablet_manager.cc:1918] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:36.456915 10221 log.cc:1196] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-2/wal/wals/b3a1a6ce048e4a6aaec4bf73ddec6059
I20260808 14:39:36.457160 10221 ts_tablet_manager.cc:1939] T b3a1a6ce048e4a6aaec4bf73ddec6059 P b17c0852d2314ac49b28ea0076997c0c: Deleting consensus metadata
I20260808 14:39:36.457774 10220 tablet_replica.cc:330] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: stopping tablet replica
I20260808 14:39:36.457888 10220 raft_consensus.cc:2229] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:39:36.457993 10220 raft_consensus.cc:2258] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:39:36.458655 10220 ts_tablet_manager.cc:1905] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:39:36.460196 10220 ts_tablet_manager.cc:1918] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:39:36.460319 10220 log.cc:1196] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: Deleting WAL directory at /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199735403457-20804-0/minicluster-data/ts-1/wal/wals/b3a1a6ce048e4a6aaec4bf73ddec6059
I20260808 14:39:36.460654 10220 ts_tablet_manager.cc:1939] T b3a1a6ce048e4a6aaec4bf73ddec6059 P 114380fa47564d91a73cdee35ccac668: Deleting consensus metadata
I20260808 14:39:36.460807 9673 catalog_manager.cc:4841] TS b17c0852d2314ac49b28ea0076997c0c (127.20.81.3:39925): tablet b3a1a6ce048e4a6aaec4bf73ddec6059 (table test-table [id=e0b4f728049f49579ee4bc952542ed2f]) successfully deleted
I20260808 14:39:36.461073 9671 catalog_manager.cc:4841] TS 114380fa47564d91a73cdee35ccac668 (127.20.81.2:39819): tablet b3a1a6ce048e4a6aaec4bf73ddec6059 (table test-table [id=e0b4f728049f49579ee4bc952542ed2f]) successfully deleted
W20260808 14:39:36.463152 9673 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.81.1:46509 (error 108)
I20260808 14:39:36.463397 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 9898
I20260808 14:39:36.463678 10191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:36.463543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.1:46509 (local address 127.0.0.1:37936)
0808 14:39:36.463594 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:39:36.463631 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.1:46509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:39:36.463783 9673 catalog_manager.cc:4584] TS 3a6a3d8439164351b26cc33ee5aa2f6a (127.20.81.1:46509): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b3a1a6ce048e4a6aaec4bf73ddec6059: Network error: Client connection negotiation failed: client connection to 127.20.81.1:46509: connect: Connection refused (error 111)
I20260808 14:39:36.470042 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 10040
I20260808 14:39:36.476199 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 9653
2026-08-08T14:39:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (884 ms)
[----------] 6 tests from EncryptionPolicyTest (8575 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:36 dist-test-slave-8n49 krb5kdc[10226](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:36 dist-test-slave-8n49 krb5kdc[10226](info): set up 2 sockets
Aug 08 14:39:36 dist-test-slave-8n49 krb5kdc[10226](info): commencing operation
krb5kdc: starting...
W20260808 14:39:37.564846 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:37 dist-test-slave-8n49 krb5kdc[10226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:37.691751 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38081
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:37.775942 10241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:37.776163 10241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:37.776187 10241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:37.777431 10241 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:37.777474 10241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:37.777489 10241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:37.777501 10241 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:37.777551 10241 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:37.779043 10241 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38081
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:37.779309 10241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:37.779551 10241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:37.784333 10247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:37.784387 10246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:37.784333 10249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:37.784466 10241 server_base.cc:1034] running on GCE node
I20260808 14:39:37.784739 10241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:37.785005 10241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:37.786180 10241 hybrid_clock.cc:648] HybridClock initialized: now 1786199977786167 us; error 45 us; skew 500 ppm
Aug 08 14:39:37 dist-test-slave-8n49 krb5kdc[10226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199977, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:37.788708 10241 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:37.789201 10241 webserver.cc:460] Webserver started at http://127.0.0.1:33059/ using document root <none> and password file <none>
I20260808 14:39:37.789435 10241 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:37.789503 10241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:37.789641 10241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:37.790726 10241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a"
format_stamp: "Formatted at 2026-08-08 14:39:37 on dist-test-slave-8n49"
server_key: "6a01af5545226861d14b58e14db86306"
server_key_iv: "5f6b240e076a7f6ef0b1b2da23ec05f9"
server_key_version: "encryptionkey@0"
I20260808 14:39:37.791117 10241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a"
format_stamp: "Formatted at 2026-08-08 14:39:37 on dist-test-slave-8n49"
server_key: "6a01af5545226861d14b58e14db86306"
server_key_iv: "5f6b240e076a7f6ef0b1b2da23ec05f9"
server_key_version: "encryptionkey@0"
I20260808 14:39:37.792533 10241 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:37.793411 10258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:37.793593 10241 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:37.793696 10241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a"
format_stamp: "Formatted at 2026-08-08 14:39:37 on dist-test-slave-8n49"
server_key: "6a01af5545226861d14b58e14db86306"
server_key_iv: "5f6b240e076a7f6ef0b1b2da23ec05f9"
server_key_version: "encryptionkey@0"
I20260808 14:39:37.793783 10241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:37.812760 10241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:37.815191 10241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:37.815364 10241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:37.819718 10241 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38081
I20260808 14:39:37.819758 10317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38081 every 8 connection(s)
I20260808 14:39:37.820165 10241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:37.821112 10318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:37.823395 10318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a: Bootstrap starting.
I20260808 14:39:37.823957 10318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:37.824208 10318 log.cc:824] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:37.824997 10318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a: No bootstrap required, opened a new log
I20260808 14:39:37.826592 10318 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38081 } }
I20260808 14:39:37.826742 10318 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:37.826771 10318 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf7b0eef7bde4728aa7bf3c1a1f70e8a, State: Initialized, Role: FOLLOWER
I20260808 14:39:37.826972 10318 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38081 } }
I20260808 14:39:37.827067 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 10241
I20260808 14:39:37.827085 10318 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:37.827122 10318 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:37.827188 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:37.827183 10318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:37.827435 20804 external_mini_cluster.cc:1428] Setting key 402b857f6f08424bfb6172cb6792492c
I20260808 14:39:37.827973 10318 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38081 } }
I20260808 14:39:37.828110 10318 leader_election.cc:302] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf7b0eef7bde4728aa7bf3c1a1f70e8a; no voters:
I20260808 14:39:37.828281 10318 leader_election.cc:288] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:37.828356 10323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:37.828497 10323 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [term 1 LEADER]: Becoming Leader. State: Replica: cf7b0eef7bde4728aa7bf3c1a1f70e8a, State: Running, Role: LEADER
I20260808 14:39:37.828572 10318 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:37.828615 10323 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38081 } }
I20260808 14:39:37.829146 10325 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38081 } } }
I20260808 14:39:37.829237 10325 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:37.829411 10326 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf7b0eef7bde4728aa7bf3c1a1f70e8a. Latest consensus state: current_term: 1 leader_uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7b0eef7bde4728aa7bf3c1a1f70e8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38081 } } }
I20260808 14:39:37.829488 10326 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:37.829473 10334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:37.830482 10334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:37.832270 10334 catalog_manager.cc:1347] Generated new cluster ID: ec46808bcc34407daa8ff7f4acc6971d
I20260808 14:39:37.832329 10334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:39:37 dist-test-slave-8n49 krb5kdc[10226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:39:37.839502 10322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:37.828024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45553 (local address 127.0.0.1:38081)
0808 14:39:37.828277 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:37.828287 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:37.828324 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:39:37.828456 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:37.828463 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:37.828532 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:37.829632 (+ 1100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:37.829782 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:37.831304 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:37.832273 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:37.832859 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:37.832985 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:37.835471 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:37.835475 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:37.835476 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:37.835488 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:37.837836 (+ 2348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:37.838265 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:37.838273 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:37.838273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:37.838377 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:37.838627 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:37.838628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:37.838628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:37.838905 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:37.839092 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:37.839214 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:39:37.839322 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":109,"threads_started":1}
I20260808 14:39:37.840744 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:37.848493 10322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:37.842416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52813 (local address 127.0.0.1:38081)
0808 14:39:37.842458 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:37.842459 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:37.842468 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:37.842538 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:37.842539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:37.842548 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:37.842603 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:37.843127 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:37.843615 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:37.844329 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:37.844602 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:37.844686 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:37.845902 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:37.845903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:37.845903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:37.845911 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:37.847309 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:37.847686 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:37.847688 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:37.847688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:37.847750 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:37.847978 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:37.847979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:37.847979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:37.848093 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:37.848208 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:37.848330 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:39:37.848393 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:39:37.851099 10334 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:37.851594 10334 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:37.856189 10334 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf7b0eef7bde4728aa7bf3c1a1f70e8a: Generated new TSK 0
I20260808 14:39:37.856374 10334 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:37.859674 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 10241
W20260808 14:39:37.865475 10224 connection.cc:535] client connection to 127.0.0.1:38081 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38081): Connection reset by peer (error 104)
2026-08-08T14:39:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1382 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:37 dist-test-slave-8n49 krb5kdc[10352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:37 dist-test-slave-8n49 krb5kdc[10352](info): set up 2 sockets
Aug 08 14:39:37 dist-test-slave-8n49 krb5kdc[10352](info): commencing operation
krb5kdc: starting...
W20260808 14:39:38.968621 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:39 dist-test-slave-8n49 krb5kdc[10352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:39.091567 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45129
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:39.175691 10366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:39.175957 10366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:39.176011 10366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:39.177253 10366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:39.177330 10366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:39.177357 10366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:39.177412 10366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:39.177448 10366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:39.178937 10366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45129
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:39.179225 10366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:39.179458 10366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:39.184391 10372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:39.184389 10374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:39.184378 10371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:39.184765 10366 server_base.cc:1034] running on GCE node
I20260808 14:39:39.184993 10366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:39.185235 10366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:39.186378 10366 hybrid_clock.cc:648] HybridClock initialized: now 1786199979186365 us; error 29 us; skew 500 ppm
Aug 08 14:39:39 dist-test-slave-8n49 krb5kdc[10352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199979, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:39.192103 10366 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:39.192642 10366 webserver.cc:460] Webserver started at http://127.0.0.1:42487/ using document root <none> and password file <none>
I20260808 14:39:39.192833 10366 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:39.192873 10366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:39.192967 10366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:39.193996 10366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9"
format_stamp: "Formatted at 2026-08-08 14:39:39 on dist-test-slave-8n49"
server_key: "c7aabb7deb84d88e09aa0bb457e1e83b"
server_key_iv: "b841bbfe6f1a682b0d41b6e1c6b73213"
server_key_version: "encryptionkey@0"
I20260808 14:39:39.194315 10366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9"
format_stamp: "Formatted at 2026-08-08 14:39:39 on dist-test-slave-8n49"
server_key: "c7aabb7deb84d88e09aa0bb457e1e83b"
server_key_iv: "b841bbfe6f1a682b0d41b6e1c6b73213"
server_key_version: "encryptionkey@0"
I20260808 14:39:39.195688 10366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:39:39.196395 10381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:39.196651 10366 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:39:39.196762 10366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9"
format_stamp: "Formatted at 2026-08-08 14:39:39 on dist-test-slave-8n49"
server_key: "c7aabb7deb84d88e09aa0bb457e1e83b"
server_key_iv: "b841bbfe6f1a682b0d41b6e1c6b73213"
server_key_version: "encryptionkey@0"
I20260808 14:39:39.196838 10366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:39.217413 10366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:39.219539 10366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:39.219691 10366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:39.224110 10366 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45129
I20260808 14:39:39.224150 10436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45129 every 8 connection(s)
I20260808 14:39:39.224530 10366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:39.225493 10437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:39.227118 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 10366
I20260808 14:39:39.227273 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:39.227499 20804 external_mini_cluster.cc:1428] Setting key ed809157c1aef2a42380219e7dcbc211
I20260808 14:39:39.228240 10437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9: Bootstrap starting.
I20260808 14:39:39.229172 10437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:39.229521 10437 log.cc:824] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:39.230314 10437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9: No bootstrap required, opened a new log
I20260808 14:39:39.232676 10437 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260808 14:39:39.232859 10437 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:39.232904 10437 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5d3a798d4c40fe9d1c45dbdaaa90f9, State: Initialized, Role: FOLLOWER
I20260808 14:39:39.233057 10437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260808 14:39:39.233155 10437 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:39.233191 10437 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:39.233237 10437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:39.233902 10440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:39.228069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51463 (local address 127.0.0.1:45129)
0808 14:39:39.228293 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:39.228310 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:39.228345 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:39:39.229003 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:39.229013 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:39.229077 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:39.229244 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:39.229492 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:39.230848 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:39.231613 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:39.232307 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:39.232438 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:39.233176 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:39.233181 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:39.233181 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:39.233404 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:39.233444 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:39.233470 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:39.233565 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:39.233651 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 14:39:39.233679 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":99,"threads_started":1}
I20260808 14:39:39.234019 10437 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260808 14:39:39.234123 10437 leader_election.cc:302] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a5d3a798d4c40fe9d1c45dbdaaa90f9; no voters:
I20260808 14:39:39.234282 10437 leader_election.cc:288] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:39.234316 10442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:39.234470 10442 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a5d3a798d4c40fe9d1c45dbdaaa90f9, State: Running, Role: LEADER
I20260808 14:39:39.234588 10437 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:39.234625 10442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260808 14:39:39.234954 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:39.235020 10442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a5d3a798d4c40fe9d1c45dbdaaa90f9. Latest consensus state: current_term: 1 leader_uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } } }
I20260808 14:39:39.235107 10442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:39.236203 10445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5d3a798d4c40fe9d1c45dbdaaa90f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } } }
I20260808 14:39:39.236294 10445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9 [sys.catalog]: This master's current role is: LEADER
W20260808 14:39:39.236757 10461 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:39:39.236821 10461 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:39:39.236924 10451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:39.237166 10451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:39.238716 10451 catalog_manager.cc:1347] Generated new cluster ID: 02aebb292ee54198b70853c908733482
I20260808 14:39:39.238771 10451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:39.240048 10440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:39.236653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37975 (local address 127.0.0.1:45129)
0808 14:39:39.236692 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:39.236694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:39.236886 (+ 192us) server_negotiation.cc:407] Connection header received
0808 14:39:39.236976 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:39.236977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:39.237020 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:39.237072 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:39.237281 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:39.237772 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:39.238724 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:39.238990 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:39.239025 (+ 35us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:39.239750 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:39.239752 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:39.239752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:39.239757 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:39.239771 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:39.239775 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:39.239871 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:39.239942 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 14:39:39.239952 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:39:39.247686 10451 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:39.248207 10451 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:39.252965 10451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a5d3a798d4c40fe9d1c45dbdaaa90f9: Generated new TSK 0
I20260808 14:39:39.253141 10451 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:39.257139 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 10366
W20260808 14:39:39.265655 10349 connection.cc:535] client connection to 127.0.0.1:45129 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45129): Connection reset by peer (error 104)
2026-08-08T14:39:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1400 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:39 dist-test-slave-8n49 krb5kdc[10474](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:39 dist-test-slave-8n49 krb5kdc[10474](info): set up 2 sockets
Aug 08 14:39:39 dist-test-slave-8n49 krb5kdc[10474](info): commencing operation
krb5kdc: starting...
W20260808 14:39:40.366014 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:40 dist-test-slave-8n49 krb5kdc[10474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:40.488974 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36361
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:40.571193 10487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:40.571451 10487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:40.571501 10487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:40.572678 10487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:40.572748 10487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:40.572775 10487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:40.572808 10487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:40.572831 10487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:40.574308 10487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36361
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:40.574594 10487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:40.574824 10487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:40.579823 10492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:40.579795 10493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:40.579803 10495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:40.580049 10487 server_base.cc:1034] running on GCE node
I20260808 14:39:40.580310 10487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:40.580647 10487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:40.581841 10487 hybrid_clock.cc:648] HybridClock initialized: now 1786199980581826 us; error 29 us; skew 500 ppm
Aug 08 14:39:40 dist-test-slave-8n49 krb5kdc[10474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199980, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:40.584455 10487 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:40.584904 10487 webserver.cc:460] Webserver started at http://127.0.0.1:41387/ using document root <none> and password file <none>
I20260808 14:39:40.585148 10487 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:40.585218 10487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:40.585364 10487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:40.586416 10487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "68d1eca9b8664fc9b7c93bc48b02370e"
format_stamp: "Formatted at 2026-08-08 14:39:40 on dist-test-slave-8n49"
server_key: "7382f41a4f13379bdcee47ba86328be9"
server_key_iv: "f5730f89ff9ffe358f785374f3524c08"
server_key_version: "encryptionkey@0"
I20260808 14:39:40.586783 10487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "68d1eca9b8664fc9b7c93bc48b02370e"
format_stamp: "Formatted at 2026-08-08 14:39:40 on dist-test-slave-8n49"
server_key: "7382f41a4f13379bdcee47ba86328be9"
server_key_iv: "f5730f89ff9ffe358f785374f3524c08"
server_key_version: "encryptionkey@0"
I20260808 14:39:40.588165 10487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:39:40.589035 10503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:40.589226 10487 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:39:40.589334 10487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "68d1eca9b8664fc9b7c93bc48b02370e"
format_stamp: "Formatted at 2026-08-08 14:39:40 on dist-test-slave-8n49"
server_key: "7382f41a4f13379bdcee47ba86328be9"
server_key_iv: "f5730f89ff9ffe358f785374f3524c08"
server_key_version: "encryptionkey@0"
I20260808 14:39:40.589409 10487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:40.592634 10487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:40.594535 10487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:40.594692 10487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:40.598697 10487 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36361
I20260808 14:39:40.598762 10558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36361 every 8 connection(s)
I20260808 14:39:40.599103 10487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:40.600097 10559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:40.602363 10559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e: Bootstrap starting.
I20260808 14:39:40.602901 10559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:40.603149 10559 log.cc:824] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:40.603777 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 10487
I20260808 14:39:40.603790 10559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e: No bootstrap required, opened a new log
I20260808 14:39:40.603929 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:40.604115 20804 external_mini_cluster.cc:1428] Setting key 59a8de3065391db1f6c46d90ac18a1c3
I20260808 14:39:40.606094 10559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d1eca9b8664fc9b7c93bc48b02370e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36361 } }
I20260808 14:39:40.606339 10559 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:40.606436 10559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68d1eca9b8664fc9b7c93bc48b02370e, State: Initialized, Role: FOLLOWER
I20260808 14:39:40.606606 10559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d1eca9b8664fc9b7c93bc48b02370e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36361 } }
I20260808 14:39:40.606700 10559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:40.606752 10559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:40.606801 10559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:40.607416 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:40.604690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36969 (local address 127.0.0.1:36361)
0808 14:39:40.604928 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:40.604937 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:40.604972 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:39:40.606057 (+ 1085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:40.606067 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:40.606104 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:40.606259 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:40.606929 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:40.606933 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:40.606933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:40.606939 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:40.606983 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:40.606999 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:40.607074 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:40.607133 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 14:39:40.607181 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":108,"threads_started":1}
I20260808 14:39:40.607964 10559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d1eca9b8664fc9b7c93bc48b02370e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36361 } }
I20260808 14:39:40.608100 10559 leader_election.cc:302] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68d1eca9b8664fc9b7c93bc48b02370e; no voters:
I20260808 14:39:40.608268 10559 leader_election.cc:288] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:40.608289 10565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:40.608395 10565 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [term 1 LEADER]: Becoming Leader. State: Replica: 68d1eca9b8664fc9b7c93bc48b02370e, State: Running, Role: LEADER
I20260808 14:39:40.608469 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:40.608521 10559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:40.608515 10565 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d1eca9b8664fc9b7c93bc48b02370e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36361 } }
I20260808 14:39:40.609529 10566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68d1eca9b8664fc9b7c93bc48b02370e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d1eca9b8664fc9b7c93bc48b02370e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36361 } } }
I20260808 14:39:40.609624 10566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:40.609794 10567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68d1eca9b8664fc9b7c93bc48b02370e. Latest consensus state: current_term: 1 leader_uuid: "68d1eca9b8664fc9b7c93bc48b02370e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d1eca9b8664fc9b7c93bc48b02370e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36361 } } }
I20260808 14:39:40.609864 10567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e [sys.catalog]: This master's current role is: LEADER
W20260808 14:39:40.610566 10589 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:39:40.610637 10589 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:39:40.610776 10581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:40.610953 10581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:40.611438 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:40.610136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53659 (local address 127.0.0.1:36361)
0808 14:39:40.610168 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:40.610170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:40.610252 (+ 82us) server_negotiation.cc:407] Connection header received
0808 14:39:40.610336 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:40.610337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:40.610343 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:40.610391 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:40.611203 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:40.611204 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:40.611204 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:40.611208 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:40.611222 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:40.611226 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:40.611258 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:40.611365 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 14:39:40.611379 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:39:40.613583 10581 catalog_manager.cc:1347] Generated new cluster ID: 24dddc54a4654d0e8d6d2188ab22dd97
I20260808 14:39:40.613652 10581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:40.620275 10581 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:40.620450 10581 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:40.625680 10581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68d1eca9b8664fc9b7c93bc48b02370e: Generated new TSK 0
I20260808 14:39:40.625867 10581 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:40.631405 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 10487
2026-08-08T14:39:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1375 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:40 dist-test-slave-8n49 krb5kdc[10596](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:40 dist-test-slave-8n49 krb5kdc[10596](info): set up 2 sockets
Aug 08 14:39:40 dist-test-slave-8n49 krb5kdc[10596](info): commencing operation
krb5kdc: starting...
W20260808 14:39:41.719323 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:41 dist-test-slave-8n49 krb5kdc[10596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:41.842734 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44221
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:41.926409 10610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:41.926632 10610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:41.926657 10610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:41.927876 10610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:41.927920 10610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:41.927935 10610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:41.927979 10610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:41.927999 10610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:41.929581 10610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:41.929836 10610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:41.930078 10610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:39:41.934974 10610 server_base.cc:1034] running on GCE node
W20260808 14:39:41.934937 10616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:41.934965 10618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:41.934943 10615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:41.935312 10610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:41.935606 10610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:41.936770 10610 hybrid_clock.cc:648] HybridClock initialized: now 1786199981936767 us; error 39 us; skew 500 ppm
Aug 08 14:39:41 dist-test-slave-8n49 krb5kdc[10596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199981, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:41.939267 10610 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:41.939742 10610 webserver.cc:460] Webserver started at http://127.0.0.1:44519/ using document root <none> and password file <none>
I20260808 14:39:41.939992 10610 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:41.940063 10610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:41.940218 10610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:41.941337 10610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "c76aac81d58346d89f900bf8d248290c"
format_stamp: "Formatted at 2026-08-08 14:39:41 on dist-test-slave-8n49"
server_key: "67fb0b1110fea5ca1c44a369fa657564"
server_key_iv: "dc89dc8fc35a448f8d9fd0803b741bb0"
server_key_version: "encryptionkey@0"
I20260808 14:39:41.941707 10610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "c76aac81d58346d89f900bf8d248290c"
format_stamp: "Formatted at 2026-08-08 14:39:41 on dist-test-slave-8n49"
server_key: "67fb0b1110fea5ca1c44a369fa657564"
server_key_iv: "dc89dc8fc35a448f8d9fd0803b741bb0"
server_key_version: "encryptionkey@0"
I20260808 14:39:41.943084 10610 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:39:41.943858 10625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:41.944043 10610 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:39:41.944139 10610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "c76aac81d58346d89f900bf8d248290c"
format_stamp: "Formatted at 2026-08-08 14:39:41 on dist-test-slave-8n49"
server_key: "67fb0b1110fea5ca1c44a369fa657564"
server_key_iv: "dc89dc8fc35a448f8d9fd0803b741bb0"
server_key_version: "encryptionkey@0"
I20260808 14:39:41.944223 10610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:41.960201 10610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:41.962668 10610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:41.962842 10610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:41.967214 10610 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44221
I20260808 14:39:41.967286 10681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44221 every 8 connection(s)
I20260808 14:39:41.967751 10610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:41.967936 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 10610
I20260808 14:39:41.968073 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:41.968284 20804 external_mini_cluster.cc:1428] Setting key 4dd1213b3ad48fe0366e8943d04f5f4e
I20260808 14:39:41.968884 10682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:41.972223 10682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c: Bootstrap starting.
I20260808 14:39:41.972965 10682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:41.973287 10682 log.cc:824] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:41.974083 10682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c: No bootstrap required, opened a new log
Aug 08 14:39:41 dist-test-slave-8n49 krb5kdc[10596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:39:41.976040 10682 raft_consensus.cc:348] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76aac81d58346d89f900bf8d248290c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44221 } }
I20260808 14:39:41.976197 10682 raft_consensus.cc:374] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:41.976264 10682 raft_consensus.cc:729] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c76aac81d58346d89f900bf8d248290c, State: Initialized, Role: FOLLOWER
I20260808 14:39:41.976424 10682 consensus_queue.cc:260] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76aac81d58346d89f900bf8d248290c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44221 } }
I20260808 14:39:41.976523 10682 raft_consensus.cc:388] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:41.976593 10682 raft_consensus.cc:482] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:41.976665 10682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:41.977447 10682 raft_consensus.cc:504] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76aac81d58346d89f900bf8d248290c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44221 } }
I20260808 14:39:41.977562 10682 leader_election.cc:302] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c76aac81d58346d89f900bf8d248290c; no voters:
I20260808 14:39:41.977728 10682 leader_election.cc:288] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:41.977811 10687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:41.978006 10682 sys_catalog.cc:564] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:41.978017 10687 raft_consensus.cc:686] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [term 1 LEADER]: Becoming Leader. State: Replica: c76aac81d58346d89f900bf8d248290c, State: Running, Role: LEADER
I20260808 14:39:41.978219 10687 consensus_queue.cc:237] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76aac81d58346d89f900bf8d248290c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44221 } }
I20260808 14:39:41.978588 10689 sys_catalog.cc:455] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c76aac81d58346d89f900bf8d248290c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76aac81d58346d89f900bf8d248290c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44221 } } }
I20260808 14:39:41.978670 10689 sys_catalog.cc:458] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:41.978832 10690 sys_catalog.cc:455] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c76aac81d58346d89f900bf8d248290c. Latest consensus state: current_term: 1 leader_uuid: "c76aac81d58346d89f900bf8d248290c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76aac81d58346d89f900bf8d248290c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44221 } } }
I20260808 14:39:41.978900 10690 sys_catalog.cc:458] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:41.979149 10697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:41.979830 10697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:41.979900 10685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:41.968840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57599 (local address 127.0.0.1:44221)
0808 14:39:41.969098 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:41.969108 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:41.969142 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:39:41.969732 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:41.969742 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:41.969808 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:41.969966 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:41.970560 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:41.971963 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:41.972854 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:41.973502 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:41.973620 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:41.975980 (+ 2360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:41.975984 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:41.975985 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:41.975997 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:41.978051 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:41.978520 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:41.978523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:41.978524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:41.978660 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:41.978912 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:41.978913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:41.978913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:41.979243 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:41.979410 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:41.979552 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:39:41.979703 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":99,"threads_started":1}
I20260808 14:39:41.981177 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:41.981485 10697 catalog_manager.cc:1347] Generated new cluster ID: 6223320ddb3840de8c4d449956717d0c
I20260808 14:39:41.981535 10697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:41.989830 10697 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:41.990031 10685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:41.982652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54937 (local address 127.0.0.1:44221)
0808 14:39:41.982687 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:41.982688 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:41.982942 (+ 254us) server_negotiation.cc:407] Connection header received
0808 14:39:41.982976 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:41.982977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:41.982987 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:41.983050 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:41.983650 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:41.984376 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:41.985365 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:41.985712 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:41.985790 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:41.987093 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:41.987094 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:41.987095 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:41.987102 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:41.988708 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:41.989184 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:41.989185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:41.989185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:41.989241 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:41.989464 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:41.989465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:41.989465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:41.989613 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:41.989725 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:41.989866 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 14:39:41.989950 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:39:41.990579 10697 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:41.998395 10697 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c76aac81d58346d89f900bf8d248290c: Generated new TSK 0
I20260808 14:39:41.998582 10697 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:42.003569 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 10610
2026-08-08T14:39:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1368 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:42 dist-test-slave-8n49 krb5kdc[10716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:42 dist-test-slave-8n49 krb5kdc[10716](info): set up 2 sockets
Aug 08 14:39:42 dist-test-slave-8n49 krb5kdc[10716](info): commencing operation
krb5kdc: starting...
W20260808 14:39:43.080448 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:43 dist-test-slave-8n49 krb5kdc[10716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:43.201579 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41749
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:43.283963 10731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:43.284206 10731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:43.284248 10731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:43.285868 10731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:43.285923 10731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:43.285946 10731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:43.285967 10731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:43.286018 10731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:43.287573 10731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41749
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:43.287838 10731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:43.288091 10731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:43.293239 10736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:43.293231 10737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:43.293257 10731 server_base.cc:1034] running on GCE node
W20260808 14:39:43.293253 10739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:43.293764 10731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:43.294046 10731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:43.295205 10731 hybrid_clock.cc:648] HybridClock initialized: now 1786199983295197 us; error 29 us; skew 500 ppm
Aug 08 14:39:43 dist-test-slave-8n49 krb5kdc[10716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199983, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:43.297904 10731 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:43.298347 10731 webserver.cc:460] Webserver started at http://127.0.0.1:38591/ using document root <none> and password file <none>
I20260808 14:39:43.298599 10731 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:43.298648 10731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:43.298825 10731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:43.299901 10731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "3cf0117e5887493d8640f745a24d58dd"
format_stamp: "Formatted at 2026-08-08 14:39:43 on dist-test-slave-8n49"
server_key: "6fc435e35a9ba955d7593a2afb7accea"
server_key_iv: "b73f2c0116910693420d7582541e175a"
server_key_version: "encryptionkey@0"
I20260808 14:39:43.300302 10731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "3cf0117e5887493d8640f745a24d58dd"
format_stamp: "Formatted at 2026-08-08 14:39:43 on dist-test-slave-8n49"
server_key: "6fc435e35a9ba955d7593a2afb7accea"
server_key_iv: "b73f2c0116910693420d7582541e175a"
server_key_version: "encryptionkey@0"
I20260808 14:39:43.301733 10731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:43.302451 10746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:43.302644 10731 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:43.302732 10731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "3cf0117e5887493d8640f745a24d58dd"
format_stamp: "Formatted at 2026-08-08 14:39:43 on dist-test-slave-8n49"
server_key: "6fc435e35a9ba955d7593a2afb7accea"
server_key_iv: "b73f2c0116910693420d7582541e175a"
server_key_version: "encryptionkey@0"
I20260808 14:39:43.302786 10731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:43.320161 10731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:43.322237 10731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:43.322353 10731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:43.326648 10731 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41749
I20260808 14:39:43.326722 10803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41749 every 8 connection(s)
I20260808 14:39:43.327077 10731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:43.328006 10804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:43.330464 10804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd: Bootstrap starting.
I20260808 14:39:43.331092 10804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:43.331416 10804 log.cc:824] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:43.332154 10804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd: No bootstrap required, opened a new log
I20260808 14:39:43.333890 10804 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cf0117e5887493d8640f745a24d58dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } }
I20260808 14:39:43.334061 10804 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:43.334115 10804 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cf0117e5887493d8640f745a24d58dd, State: Initialized, Role: FOLLOWER
I20260808 14:39:43.334299 10804 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cf0117e5887493d8640f745a24d58dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } }
I20260808 14:39:43.334407 10804 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:43.334455 10804 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:43.334511 10804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:43.335052 10804 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cf0117e5887493d8640f745a24d58dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } }
I20260808 14:39:43.335175 10804 leader_election.cc:302] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cf0117e5887493d8640f745a24d58dd; no voters:
I20260808 14:39:43.335366 10804 leader_election.cc:288] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:43.335400 10807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:43.335625 10807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [term 1 LEADER]: Becoming Leader. State: Replica: 3cf0117e5887493d8640f745a24d58dd, State: Running, Role: LEADER
I20260808 14:39:43.335737 10807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cf0117e5887493d8640f745a24d58dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } }
I20260808 14:39:43.335870 10804 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:43.336082 10808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cf0117e5887493d8640f745a24d58dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cf0117e5887493d8640f745a24d58dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } } }
I20260808 14:39:43.336169 10808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:43.336310 10810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cf0117e5887493d8640f745a24d58dd. Latest consensus state: current_term: 1 leader_uuid: "3cf0117e5887493d8640f745a24d58dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cf0117e5887493d8640f745a24d58dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } } }
I20260808 14:39:43.336375 10812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:43.336436 10810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:43.336831 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 10731
I20260808 14:39:43.336957 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:43.337183 20804 external_mini_cluster.cc:1428] Setting key 45ee1fc970b1837ffd731000d150e6c0
I20260808 14:39:43.337550 10812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:43.339211 10812 catalog_manager.cc:1347] Generated new cluster ID: 7905d5eda76548ab9dbdc221249e6082
I20260808 14:39:43.339267 10812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:43.344228 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:43.337868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50401 (local address 127.0.0.1:41749)
0808 14:39:43.338256 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:43.338266 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:43.338296 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:39:43.338416 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:43.338424 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:43.338481 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:43.338624 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:43.339092 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:43.340595 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:43.341765 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:43.342420 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:43.342532 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:43.343320 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:43.343324 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:43.343324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:43.343537 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:43.343575 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:43.343589 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:43.343663 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:43.343768 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 14:39:43.343833 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":73,"threads_started":1}
I20260808 14:39:43.345196 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:43.350245 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:43.346785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49281 (local address 127.0.0.1:41749)
0808 14:39:43.346817 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:43.346819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:43.346904 (+ 85us) server_negotiation.cc:407] Connection header received
0808 14:39:43.346962 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:43.346963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:43.346974 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:43.347030 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:43.347159 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:43.347878 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:43.348931 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:43.349230 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:43.349288 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:43.349993 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:43.349995 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:43.349996 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:43.350001 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:43.350016 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:43.350021 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:43.350073 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:43.350142 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:39:43.350168 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:39:43.359159 10812 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:43.359709 10812 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:43.365899 10812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cf0117e5887493d8640f745a24d58dd: Generated new TSK 0
I20260808 14:39:43.366099 10812 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:43.368364 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 10731
2026-08-08T14:39:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1365 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:43 dist-test-slave-8n49 krb5kdc[10840](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:43 dist-test-slave-8n49 krb5kdc[10840](info): set up 2 sockets
Aug 08 14:39:43 dist-test-slave-8n49 krb5kdc[10840](info): commencing operation
krb5kdc: starting...
W20260808 14:39:44.448474 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:44 dist-test-slave-8n49 krb5kdc[10840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:44.567874 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34593
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:44.650540 10854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:44.650816 10854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:44.650857 10854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:44.652035 10854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:44.652117 10854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:44.652143 10854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:44.652186 10854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:44.652209 10854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:44.653842 10854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:44.654153 10854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:44.654393 10854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:44.659276 10861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:44.659261 10864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:44.659271 10862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:44.659518 10854 server_base.cc:1034] running on GCE node
I20260808 14:39:44.659777 10854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:44.660030 10854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:44.661171 10854 hybrid_clock.cc:648] HybridClock initialized: now 1786199984661149 us; error 38 us; skew 500 ppm
Aug 08 14:39:44 dist-test-slave-8n49 krb5kdc[10840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199984, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:44.668139 10854 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:44.668638 10854 webserver.cc:460] Webserver started at http://127.0.0.1:40939/ using document root <none> and password file <none>
I20260808 14:39:44.668834 10854 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:44.668875 10854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:44.668967 10854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:44.670020 10854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "88ce47a9e6b349d894576bbf79398e2b"
format_stamp: "Formatted at 2026-08-08 14:39:44 on dist-test-slave-8n49"
server_key: "fb7dd62a611aa2767f1bb451f0330e20"
server_key_iv: "069b52d980c802c7164b5297ed773929"
server_key_version: "encryptionkey@0"
I20260808 14:39:44.670334 10854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "88ce47a9e6b349d894576bbf79398e2b"
format_stamp: "Formatted at 2026-08-08 14:39:44 on dist-test-slave-8n49"
server_key: "fb7dd62a611aa2767f1bb451f0330e20"
server_key_iv: "069b52d980c802c7164b5297ed773929"
server_key_version: "encryptionkey@0"
I20260808 14:39:44.671636 10854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:39:44.672355 10872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:44.672528 10854 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:39:44.672675 10854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "88ce47a9e6b349d894576bbf79398e2b"
format_stamp: "Formatted at 2026-08-08 14:39:44 on dist-test-slave-8n49"
server_key: "fb7dd62a611aa2767f1bb451f0330e20"
server_key_iv: "069b52d980c802c7164b5297ed773929"
server_key_version: "encryptionkey@0"
I20260808 14:39:44.672755 10854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:44.675981 10854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:44.678287 10854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:44.678483 10854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:44.682503 10854 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34593
I20260808 14:39:44.682574 10928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34593 every 8 connection(s)
I20260808 14:39:44.682906 10854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:44.683899 10929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:44.686183 10929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b: Bootstrap starting.
I20260808 14:39:44.686722 10929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:44.686966 10929 log.cc:824] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:44.687642 10929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b: No bootstrap required, opened a new log
I20260808 14:39:44.689255 10929 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ce47a9e6b349d894576bbf79398e2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34593 } }
I20260808 14:39:44.689389 10929 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:44.689411 10929 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ce47a9e6b349d894576bbf79398e2b, State: Initialized, Role: FOLLOWER
I20260808 14:39:44.689513 10929 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ce47a9e6b349d894576bbf79398e2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34593 } }
I20260808 14:39:44.689594 10929 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:44.689633 10929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:44.689708 10929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:44.690253 10929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ce47a9e6b349d894576bbf79398e2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34593 } }
I20260808 14:39:44.690374 10929 leader_election.cc:302] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88ce47a9e6b349d894576bbf79398e2b; no voters:
I20260808 14:39:44.690563 10929 leader_election.cc:288] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:44.690608 10933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:44.690790 10933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [term 1 LEADER]: Becoming Leader. State: Replica: 88ce47a9e6b349d894576bbf79398e2b, State: Running, Role: LEADER
I20260808 14:39:44.690831 10929 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:44.690908 10933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ce47a9e6b349d894576bbf79398e2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34593 } }
I20260808 14:39:44.691283 10935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88ce47a9e6b349d894576bbf79398e2b. Latest consensus state: current_term: 1 leader_uuid: "88ce47a9e6b349d894576bbf79398e2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ce47a9e6b349d894576bbf79398e2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34593 } } }
I20260808 14:39:44.691407 10934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88ce47a9e6b349d894576bbf79398e2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ce47a9e6b349d894576bbf79398e2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34593 } } }
I20260808 14:39:44.691427 10935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:44.691500 10934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:44.691854 10944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:44.692418 10944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:44.692854 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 10854
I20260808 14:39:44.692994 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:44.693183 20804 external_mini_cluster.cc:1428] Setting key d157fc004b30885c55319e7bda19240a
I20260808 14:39:44.694126 10944 catalog_manager.cc:1347] Generated new cluster ID: 85244816b2d74bc7baf236fdcdb9f1b3
I20260808 14:39:44.694186 10944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:44.695856 10957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:44.693658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46477 (local address 127.0.0.1:34593)
0808 14:39:44.694182 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:44.694191 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:44.694222 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:39:44.694338 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:44.694345 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:44.694374 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:44.694520 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:44.695288 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:44.695293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:44.695293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:44.695299 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:44.695343 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:44.695360 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:44.695435 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:44.695515 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:39:44.695683 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":61,"threads_started":1}
I20260808 14:39:44.696827 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:44.699335 10957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:44.698355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38217 (local address 127.0.0.1:34593)
0808 14:39:44.698390 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:44.698392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:44.698401 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:39:44.698459 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:44.698460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:44.698465 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:44.698524 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:44.699119 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:44.699121 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:44.699121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:44.699126 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:44.699141 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:44.699146 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:44.699209 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:44.699259 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 14:39:44.699270 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:39:44.712641 10944 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:44.712814 10944 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:44.717708 10944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88ce47a9e6b349d894576bbf79398e2b: Generated new TSK 0
I20260808 14:39:44.717900 10944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:44.720587 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 10854
2026-08-08T14:39:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:44 dist-test-slave-8n49 krb5kdc[10966](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:44 dist-test-slave-8n49 krb5kdc[10966](info): set up 2 sockets
Aug 08 14:39:44 dist-test-slave-8n49 krb5kdc[10966](info): commencing operation
krb5kdc: starting...
W20260808 14:39:45.808173 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:45 dist-test-slave-8n49 krb5kdc[10966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:45.927702 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45339
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:46.009405 10983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:46.009655 10983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:46.009691 10983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:46.010854 10983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:46.010931 10983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:46.010957 10983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:46.010987 10983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:46.011015 10983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:46.012542 10983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:46.012846 10983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:46.013080 10983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:46.018205 10991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:46.018180 10988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:46.018265 10989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:46.018352 10983 server_base.cc:1034] running on GCE node
I20260808 14:39:46.018646 10983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:46.018966 10983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:46.020146 10983 hybrid_clock.cc:648] HybridClock initialized: now 1786199986020130 us; error 29 us; skew 500 ppm
Aug 08 14:39:46 dist-test-slave-8n49 krb5kdc[10966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199986, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:46.022677 10983 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:46.023151 10983 webserver.cc:460] Webserver started at http://127.0.0.1:39523/ using document root <none> and password file <none>
I20260808 14:39:46.023406 10983 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:46.023483 10983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:46.023631 10983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:46.024892 10983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b"
format_stamp: "Formatted at 2026-08-08 14:39:46 on dist-test-slave-8n49"
server_key: "4671e8cd5122ae5b56b1c086b1f5fcae"
server_key_iv: "58eca4d3354ab3cd4b2315aa3bc1be22"
server_key_version: "encryptionkey@0"
I20260808 14:39:46.025264 10983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b"
format_stamp: "Formatted at 2026-08-08 14:39:46 on dist-test-slave-8n49"
server_key: "4671e8cd5122ae5b56b1c086b1f5fcae"
server_key_iv: "58eca4d3354ab3cd4b2315aa3bc1be22"
server_key_version: "encryptionkey@0"
I20260808 14:39:46.026597 10983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:39:46.027331 10998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:46.027504 10983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:46.027596 10983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b"
format_stamp: "Formatted at 2026-08-08 14:39:46 on dist-test-slave-8n49"
server_key: "4671e8cd5122ae5b56b1c086b1f5fcae"
server_key_iv: "58eca4d3354ab3cd4b2315aa3bc1be22"
server_key_version: "encryptionkey@0"
I20260808 14:39:46.027693 10983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:46.035523 10983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:46.037358 10983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:46.037524 10983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:46.041754 10983 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45339
I20260808 14:39:46.041786 11053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45339 every 8 connection(s)
I20260808 14:39:46.042137 10983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:46.042492 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 10983
I20260808 14:39:46.042649 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:46.042886 20804 external_mini_cluster.cc:1428] Setting key 6c5bc2e77b0884717c9beaac9bdfd684
I20260808 14:39:46.043205 11054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:46.046713 11054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b: Bootstrap starting.
I20260808 14:39:46.047358 11054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:46.047665 11054 log.cc:824] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:46.048475 11054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b: No bootstrap required, opened a new log
Aug 08 14:39:46 dist-test-slave-8n49 krb5kdc[10966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:39:46.050786 11054 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } }
I20260808 14:39:46.050956 11054 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:46.050982 11054 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ef93a74cdb4e1e9a0c1a3f5951226b, State: Initialized, Role: FOLLOWER
I20260808 14:39:46.051138 11054 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } }
I20260808 14:39:46.051249 11054 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:46.051285 11054 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:46.051335 11054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:46.052043 11054 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } }
I20260808 14:39:46.052135 11054 leader_election.cc:302] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58ef93a74cdb4e1e9a0c1a3f5951226b; no voters:
I20260808 14:39:46.052336 11054 leader_election.cc:288] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:46.052366 11060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:46.052505 11060 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [term 1 LEADER]: Becoming Leader. State: Replica: 58ef93a74cdb4e1e9a0c1a3f5951226b, State: Running, Role: LEADER
I20260808 14:39:46.052670 11060 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } }
I20260808 14:39:46.052680 11054 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:46.053092 11062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } } }
I20260808 14:39:46.053180 11062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:46.053490 11065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:46.053799 11061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58ef93a74cdb4e1e9a0c1a3f5951226b. Latest consensus state: current_term: 1 leader_uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58ef93a74cdb4e1e9a0c1a3f5951226b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } } }
I20260808 14:39:46.053983 11061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:46.054105 11065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:46.055249 11057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:46.043458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:53827 (local address 127.0.0.1:45339)
0808 14:39:46.043679 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:46.043688 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:46.043721 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:39:46.044411 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:46.044421 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:46.044486 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:46.044712 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:46.045312 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:46.046695 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:46.047518 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:46.047966 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:46.048050 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:46.050887 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:46.050891 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:46.050892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:46.050902 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:46.052910 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:46.053394 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:46.053398 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:46.053398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:46.053512 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:46.053790 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:46.053791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:46.053791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:46.054160 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:46.054842 (+ 682us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:46.054958 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 14:39:46.055061 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":95,"threads_started":1}
I20260808 14:39:46.055961 11065 catalog_manager.cc:1347] Generated new cluster ID: a0f814bdf2df4bc5883416807f1a8548
I20260808 14:39:46.056030 11065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:46.056402 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:46.065405 11057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:46.057900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:56681 (local address 127.0.0.1:45339)
0808 14:39:46.057942 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:46.057944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:46.057985 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:39:46.058071 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:46.058072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:46.058081 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:46.058107 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:46.058748 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:46.059784 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:46.060806 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:46.061128 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:46.061174 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:46.062576 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:46.062577 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:46.062578 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:46.062584 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:46.064119 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:46.064519 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:46.064520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:46.064520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:46.064594 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:46.064811 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:46.064812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:46.064812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:46.064928 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:46.064999 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:46.065246 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 14:39:46.065313 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:39:46.066468 11065 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:46.066946 11065 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:46.069715 11065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58ef93a74cdb4e1e9a0c1a3f5951226b: Generated new TSK 0
I20260808 14:39:46.069886 11065 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:46.073422 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 10983
W20260808 14:39:46.080768 10964 connection.cc:535] client connection to 127.0.0.1:45339 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45339): Connection reset by peer (error 104)
2026-08-08T14:39:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1353 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:46 dist-test-slave-8n49 krb5kdc[11087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:46 dist-test-slave-8n49 krb5kdc[11087](info): set up 2 sockets
Aug 08 14:39:46 dist-test-slave-8n49 krb5kdc[11087](info): commencing operation
krb5kdc: starting...
W20260808 14:39:47.152484 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:47 dist-test-slave-8n49 krb5kdc[11087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:47.275686 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38405
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:47.358304 11104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:47.358533 11104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:47.358559 11104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:47.359763 11104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:47.359810 11104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:47.359825 11104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:47.359838 11104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:47.359850 11104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:47.361415 11104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:47.361696 11104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:47.361933 11104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:47.366971 11113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:47.366979 11110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:47.367158 11104 server_base.cc:1034] running on GCE node
W20260808 14:39:47.366979 11111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:47.367507 11104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:47.367775 11104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:47.368937 11104 hybrid_clock.cc:648] HybridClock initialized: now 1786199987368914 us; error 42 us; skew 500 ppm
Aug 08 14:39:47 dist-test-slave-8n49 krb5kdc[11087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199987, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:47.372645 11104 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:47.373263 11104 webserver.cc:460] Webserver started at http://127.0.0.1:42477/ using document root <none> and password file <none>
I20260808 14:39:47.373519 11104 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:47.373590 11104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:47.373736 11104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:47.375216 11104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "188f13c242bf46558b1b24eba6167a30"
format_stamp: "Formatted at 2026-08-08 14:39:47 on dist-test-slave-8n49"
server_key: "b062f25e88b1966b07ce8d01467b8171"
server_key_iv: "711b3ef76f96c1438a9948653f4fa9e3"
server_key_version: "encryptionkey@0"
I20260808 14:39:47.375737 11104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "188f13c242bf46558b1b24eba6167a30"
format_stamp: "Formatted at 2026-08-08 14:39:47 on dist-test-slave-8n49"
server_key: "b062f25e88b1966b07ce8d01467b8171"
server_key_iv: "711b3ef76f96c1438a9948653f4fa9e3"
server_key_version: "encryptionkey@0"
I20260808 14:39:47.380959 11104 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:39:47.381920 11121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:47.382131 11104 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:47.382256 11104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "188f13c242bf46558b1b24eba6167a30"
format_stamp: "Formatted at 2026-08-08 14:39:47 on dist-test-slave-8n49"
server_key: "b062f25e88b1966b07ce8d01467b8171"
server_key_iv: "711b3ef76f96c1438a9948653f4fa9e3"
server_key_version: "encryptionkey@0"
I20260808 14:39:47.382344 11104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:47.414220 11104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:47.416356 11104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:47.416471 11104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:47.420401 11104 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38405
I20260808 14:39:47.420513 11174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38405 every 8 connection(s)
I20260808 14:39:47.420851 11104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:47.421344 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 11104
I20260808 14:39:47.421494 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:47.421725 20804 external_mini_cluster.cc:1428] Setting key 9a48d874a29bbc412de4a72b6c51ab5b
I20260808 14:39:47.422011 11175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:47.425066 11175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30: Bootstrap starting.
I20260808 14:39:47.425705 11175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:47.426002 11175 log.cc:824] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:47.426874 11175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30: No bootstrap required, opened a new log
I20260808 14:39:47.427596 11178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:47.422231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:51233 (local address 127.0.0.1:38405)
0808 14:39:47.422447 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:47.422457 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:47.422500 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:39:47.423179 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:47.423188 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:47.423247 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:47.423397 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:47.423608 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:47.424515 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:47.425437 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:47.425911 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:47.426032 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:47.426868 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:47.426873 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:47.426874 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:47.427109 (+ 235us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:47.427143 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:47.427155 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:47.427232 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:47.427398 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 14:39:47.427434 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":90,"threads_started":1}
I20260808 14:39:47.428783 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:47.429385 11175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188f13c242bf46558b1b24eba6167a30" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } }
I20260808 14:39:47.429556 11175 raft_consensus.cc:374] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:47.429605 11175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 188f13c242bf46558b1b24eba6167a30, State: Initialized, Role: FOLLOWER
I20260808 14:39:47.429735 11175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188f13c242bf46558b1b24eba6167a30" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } }
I20260808 14:39:47.429836 11175 raft_consensus.cc:388] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:47.429883 11175 raft_consensus.cc:482] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:47.429940 11175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:47.430806 11175 raft_consensus.cc:504] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188f13c242bf46558b1b24eba6167a30" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } }
I20260808 14:39:47.430899 11175 leader_election.cc:302] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 188f13c242bf46558b1b24eba6167a30; no voters:
I20260808 14:39:47.431072 11175 leader_election.cc:288] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:47.431103 11185 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:47.431221 11185 raft_consensus.cc:686] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [term 1 LEADER]: Becoming Leader. State: Replica: 188f13c242bf46558b1b24eba6167a30, State: Running, Role: LEADER
I20260808 14:39:47.431313 11185 consensus_queue.cc:237] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188f13c242bf46558b1b24eba6167a30" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } }
I20260808 14:39:47.431341 11175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:47.431663 11185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 188f13c242bf46558b1b24eba6167a30. Latest consensus state: current_term: 1 leader_uuid: "188f13c242bf46558b1b24eba6167a30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188f13c242bf46558b1b24eba6167a30" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } } }
I20260808 14:39:47.431742 11185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:47.431672 11186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "188f13c242bf46558b1b24eba6167a30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188f13c242bf46558b1b24eba6167a30" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } } }
I20260808 14:39:47.431886 11186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:47.431955 11190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:47.432533 11190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:47.433686 11178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:47.430190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:59437 (local address 127.0.0.1:38405)
0808 14:39:47.430259 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:47.430261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:47.430298 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:39:47.430370 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:47.430371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:47.430379 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:47.430440 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:47.430584 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:47.431137 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:47.432186 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:47.432468 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:47.432845 (+ 377us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:47.433366 (+ 521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:47.433367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:47.433367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:47.433372 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:47.433387 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:47.433392 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:47.433464 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:47.433598 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 14:39:47.433610 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:39:47.434598 11190 catalog_manager.cc:1347] Generated new cluster ID: 6de9904ad70e427ea3781bc87f817b58
I20260808 14:39:47.434650 11190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:47.459762 11190 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:47.460381 11190 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:47.470938 11190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 188f13c242bf46558b1b24eba6167a30: Generated new TSK 0
I20260808 14:39:47.471150 11190 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:47.476854 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 11104
W20260808 14:39:47.482854 11085 connection.cc:535] client connection to 127.0.0.1:38405 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38405): Connection reset by peer (error 104)
2026-08-08T14:39:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1401 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:47 dist-test-slave-8n49 krb5kdc[11206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:47 dist-test-slave-8n49 krb5kdc[11206](info): set up 2 sockets
Aug 08 14:39:47 dist-test-slave-8n49 krb5kdc[11206](info): commencing operation
krb5kdc: starting...
W20260808 14:39:48.557327 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:48 dist-test-slave-8n49 krb5kdc[11206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:48.683243 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39595
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:48.766242 11220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:48.766532 11220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:48.766577 11220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:48.767735 11220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:48.767809 11220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:48.767835 11220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:48.767863 11220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:48.767886 11220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:48.769418 11220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:48.769706 11220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:48.769940 11220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:48.774772 11228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:48.774936 11220 server_base.cc:1034] running on GCE node
W20260808 14:39:48.774797 11226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:48.774798 11225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:48.775260 11220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:48.775556 11220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:48.776742 11220 hybrid_clock.cc:648] HybridClock initialized: now 1786199988776723 us; error 28 us; skew 500 ppm
Aug 08 14:39:48 dist-test-slave-8n49 krb5kdc[11206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199988, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:48.779280 11220 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:48.779781 11220 webserver.cc:460] Webserver started at http://127.0.0.1:44029/ using document root <none> and password file <none>
I20260808 14:39:48.780018 11220 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:48.780088 11220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:48.780242 11220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:48.781399 11220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "a0707edc65104638888ececcb86a5240"
format_stamp: "Formatted at 2026-08-08 14:39:48 on dist-test-slave-8n49"
server_key: "142e45342767491b0ac696e17f5e541e"
server_key_iv: "5d17c75d6146334162f5249ac79f7093"
server_key_version: "encryptionkey@0"
I20260808 14:39:48.781771 11220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "a0707edc65104638888ececcb86a5240"
format_stamp: "Formatted at 2026-08-08 14:39:48 on dist-test-slave-8n49"
server_key: "142e45342767491b0ac696e17f5e541e"
server_key_iv: "5d17c75d6146334162f5249ac79f7093"
server_key_version: "encryptionkey@0"
I20260808 14:39:48.783135 11220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:39:48.783871 11236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:48.784047 11220 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:39:48.784154 11220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "a0707edc65104638888ececcb86a5240"
format_stamp: "Formatted at 2026-08-08 14:39:48 on dist-test-slave-8n49"
server_key: "142e45342767491b0ac696e17f5e541e"
server_key_iv: "5d17c75d6146334162f5249ac79f7093"
server_key_version: "encryptionkey@0"
I20260808 14:39:48.784230 11220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:48.787597 11220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:48.789683 11220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:48.789845 11220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:48.794162 11220 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39595
I20260808 14:39:48.794212 11292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39595 every 8 connection(s)
I20260808 14:39:48.794561 11220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:48.795578 11293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:48.798049 11293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240: Bootstrap starting.
I20260808 14:39:48.798146 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 11220
I20260808 14:39:48.798322 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:48.798521 20804 external_mini_cluster.cc:1428] Setting key 3e046f1e0d4d633120ecbccb55747e34
I20260808 14:39:48.798768 11293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:48.799120 11293 log.cc:824] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:48.799898 11293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240: No bootstrap required, opened a new log
I20260808 14:39:48.801301 11296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:48.799061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:47551 (local address 127.0.0.1:39595)
0808 14:39:48.799283 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:48.799293 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:48.799329 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:39:48.799903 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:48.799911 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:48.799961 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:48.800122 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:48.800854 (+ 732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:48.800858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:48.800858 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:48.800863 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:48.800912 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:48.800923 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:48.801015 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:48.801087 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 14:39:48.801133 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":86,"threads_started":1}
I20260808 14:39:48.802397 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:48.802403 11293 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0707edc65104638888ececcb86a5240" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39595 } }
I20260808 14:39:48.802611 11293 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:48.802660 11293 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0707edc65104638888ececcb86a5240, State: Initialized, Role: FOLLOWER
I20260808 14:39:48.802788 11293 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0707edc65104638888ececcb86a5240" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39595 } }
I20260808 14:39:48.802877 11293 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:48.802922 11293 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:48.802971 11293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:48.803516 11293 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0707edc65104638888ececcb86a5240" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39595 } }
I20260808 14:39:48.803635 11293 leader_election.cc:302] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0707edc65104638888ececcb86a5240; no voters:
I20260808 14:39:48.803798 11293 leader_election.cc:288] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:48.803831 11302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:48.804054 11302 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [term 1 LEADER]: Becoming Leader. State: Replica: a0707edc65104638888ececcb86a5240, State: Running, Role: LEADER
I20260808 14:39:48.804060 11293 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:48.804827 11302 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0707edc65104638888ececcb86a5240" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39595 } }
I20260808 14:39:48.805150 11296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:48.803928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:40891 (local address 127.0.0.1:39595)
0808 14:39:48.803975 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:48.803977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:48.804150 (+ 173us) server_negotiation.cc:407] Connection header received
0808 14:39:48.804222 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:48.804223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:48.804228 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:48.804279 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:48.804935 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:48.804936 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:48.804937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:48.804942 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:48.804959 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:48.804964 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:48.805026 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:48.805077 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 14:39:48.805089 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:39:48.805523 11303 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0707edc65104638888ececcb86a5240" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0707edc65104638888ececcb86a5240" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39595 } } }
I20260808 14:39:48.805619 11303 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:48.805955 11305 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0707edc65104638888ececcb86a5240. Latest consensus state: current_term: 1 leader_uuid: "a0707edc65104638888ececcb86a5240" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0707edc65104638888ececcb86a5240" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39595 } } }
W20260808 14:39:48.806066 11317 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 14:39:48.806090 11305 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240 [sys.catalog]: This master's current role is: LEADER
W20260808 14:39:48.806238 11317 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:39:48.806305 11318 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:48.806475 11318 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:48.807948 11318 catalog_manager.cc:1347] Generated new cluster ID: 1a30dda576884ecdb98c70572dd9701d
I20260808 14:39:48.808007 11318 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:48.824342 11318 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:48.824584 11318 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:48.830662 11318 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0707edc65104638888ececcb86a5240: Generated new TSK 0
I20260808 14:39:48.830852 11318 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:48.839383 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 11220
2026-08-08T14:39:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1363 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:48 dist-test-slave-8n49 krb5kdc[11324](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:48 dist-test-slave-8n49 krb5kdc[11324](info): set up 2 sockets
Aug 08 14:39:48 dist-test-slave-8n49 krb5kdc[11324](info): commencing operation
krb5kdc: starting...
W20260808 14:39:49.912938 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:49 dist-test-slave-8n49 krb5kdc[11324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:50.035651 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42575
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42575
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:50.118177 11337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:50.118427 11337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:50.118465 11337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:50.119625 11337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:50.119699 11337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:50.119725 11337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:50.119758 11337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:50.119781 11337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:50.121296 11337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42575
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:50.121588 11337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:50.121829 11337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:50.126709 11343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:50.126761 11344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:50.126713 11347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:50.127148 11337 server_base.cc:1034] running on GCE node
I20260808 14:39:50.127410 11337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:50.127693 11337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:50.128856 11337 hybrid_clock.cc:648] HybridClock initialized: now 1786199990128850 us; error 37 us; skew 500 ppm
Aug 08 14:39:50 dist-test-slave-8n49 krb5kdc[11324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199990, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:50.135345 11337 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:50.135797 11337 webserver.cc:460] Webserver started at http://127.0.0.1:32835/ using document root <none> and password file <none>
I20260808 14:39:50.136065 11337 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:50.136135 11337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:50.136289 11337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:50.137419 11337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "df86f81628624a7191d3d46dcbe99ee5"
format_stamp: "Formatted at 2026-08-08 14:39:50 on dist-test-slave-8n49"
server_key: "357b8bbf8e2432e649147fd3912ff8ab"
server_key_iv: "2a1259edf309be550c2ffa6356355579"
server_key_version: "encryptionkey@0"
I20260808 14:39:50.137787 11337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "df86f81628624a7191d3d46dcbe99ee5"
format_stamp: "Formatted at 2026-08-08 14:39:50 on dist-test-slave-8n49"
server_key: "357b8bbf8e2432e649147fd3912ff8ab"
server_key_iv: "2a1259edf309be550c2ffa6356355579"
server_key_version: "encryptionkey@0"
I20260808 14:39:50.139117 11337 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:39:50.139848 11354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:50.140033 11337 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:39:50.140146 11337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "df86f81628624a7191d3d46dcbe99ee5"
format_stamp: "Formatted at 2026-08-08 14:39:50 on dist-test-slave-8n49"
server_key: "357b8bbf8e2432e649147fd3912ff8ab"
server_key_iv: "2a1259edf309be550c2ffa6356355579"
server_key_version: "encryptionkey@0"
I20260808 14:39:50.140234 11337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:50.154935 11337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:50.156884 11337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:50.156996 11337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:50.160998 11337 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42575
I20260808 14:39:50.161033 11412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42575 every 8 connection(s)
I20260808 14:39:50.161398 11337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:50.162261 11413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:50.164531 11413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5: Bootstrap starting.
I20260808 14:39:50.165167 11413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:50.165413 11413 log.cc:824] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:50.166080 11413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5: No bootstrap required, opened a new log
I20260808 14:39:50.167630 11413 raft_consensus.cc:348] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df86f81628624a7191d3d46dcbe99ee5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } }
I20260808 14:39:50.167769 11413 raft_consensus.cc:374] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:50.167793 11413 raft_consensus.cc:729] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df86f81628624a7191d3d46dcbe99ee5, State: Initialized, Role: FOLLOWER
I20260808 14:39:50.167925 11413 consensus_queue.cc:260] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df86f81628624a7191d3d46dcbe99ee5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } }
I20260808 14:39:50.168008 11413 raft_consensus.cc:388] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:50.168042 11413 raft_consensus.cc:482] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:50.168076 11413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:50.168617 11413 raft_consensus.cc:504] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df86f81628624a7191d3d46dcbe99ee5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } }
I20260808 14:39:50.168718 11413 leader_election.cc:302] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df86f81628624a7191d3d46dcbe99ee5; no voters:
I20260808 14:39:50.168864 11413 leader_election.cc:288] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:50.168895 11416 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:50.169029 11416 raft_consensus.cc:686] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [term 1 LEADER]: Becoming Leader. State: Replica: df86f81628624a7191d3d46dcbe99ee5, State: Running, Role: LEADER
I20260808 14:39:50.169133 11413 sys_catalog.cc:564] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:50.169113 11416 consensus_queue.cc:237] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df86f81628624a7191d3d46dcbe99ee5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } }
I20260808 14:39:50.169603 11417 sys_catalog.cc:455] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df86f81628624a7191d3d46dcbe99ee5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df86f81628624a7191d3d46dcbe99ee5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } } }
I20260808 14:39:50.169693 11417 sys_catalog.cc:458] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:50.170149 11424 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:50.169884 11418 sys_catalog.cc:455] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df86f81628624a7191d3d46dcbe99ee5. Latest consensus state: current_term: 1 leader_uuid: "df86f81628624a7191d3d46dcbe99ee5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df86f81628624a7191d3d46dcbe99ee5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } } }
I20260808 14:39:50.170215 11418 sys_catalog.cc:458] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:50.170745 11424 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:50.170758 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 11337
I20260808 14:39:50.170879 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:50.171110 20804 external_mini_cluster.cc:1428] Setting key 1f51a195a40e18cc633e55f9bb05d281
I20260808 14:39:50.172587 11424 catalog_manager.cc:1347] Generated new cluster ID: 97713a9c57e94f0eb6bc1266dc85560c
I20260808 14:39:50.172638 11424 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:39:50 dist-test-slave-8n49 krb5kdc[11324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:39:50.183261 11435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:50.171583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:49029 (local address 127.0.0.1:42575)
0808 14:39:50.171759 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:50.171770 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:50.171870 (+ 100us) server_negotiation.cc:407] Connection header received
0808 14:39:50.172049 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:50.172056 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:50.172117 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:50.172255 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:50.173232 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:50.174659 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:50.175767 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:50.176420 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:50.176524 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:50.179581 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:50.179585 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:50.179585 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:50.179597 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:50.181551 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:50.182022 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:50.182025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:50.182025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:50.182127 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:50.182368 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:50.182369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:50.182370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:50.182659 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:50.182809 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:50.182945 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:39:50.183038 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
I20260808 14:39:50.184281 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:50.196039 11435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:50.188807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:47721 (local address 127.0.0.1:42575)
0808 14:39:50.188851 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:50.188852 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:50.188982 (+ 130us) server_negotiation.cc:407] Connection header received
0808 14:39:50.189043 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:50.189044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:50.189054 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:50.189107 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:50.189777 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:50.190497 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:50.191524 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:50.191825 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:50.191884 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:50.193309 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:50.193310 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:50.193311 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:50.193317 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:50.194813 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:50.195240 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:50.195241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:50.195241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:50.195295 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:50.195524 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:50.195524 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:50.195525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:50.195645 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:50.195746 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:50.195892 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 14:39:50.195954 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:39:50.200317 11424 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:50.200913 11424 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:50.204336 11424 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df86f81628624a7191d3d46dcbe99ee5: Generated new TSK 0
I20260808 14:39:50.204525 11424 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:50.207043 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 11337
W20260808 14:39:50.214027 11322 connection.cc:535] client connection to 127.0.0.1:42575 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42575): Connection reset by peer (error 104)
2026-08-08T14:39:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1367 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:50 dist-test-slave-8n49 krb5kdc[11444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:50 dist-test-slave-8n49 krb5kdc[11444](info): set up 2 sockets
Aug 08 14:39:50 dist-test-slave-8n49 krb5kdc[11444](info): commencing operation
krb5kdc: starting...
W20260808 14:39:51.288781 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:51 dist-test-slave-8n49 krb5kdc[11444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:51.410959 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46439
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:51.492177 11459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:51.492372 11459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:51.492415 11459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:51.493573 11459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:51.493623 11459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:51.493638 11459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:51.493677 11459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:51.493705 11459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:51.495195 11459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46439
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:51.495448 11459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:51.495661 11459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:51.500422 11466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:51.500391 11465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:51.500389 11468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:51.500705 11459 server_base.cc:1034] running on GCE node
I20260808 14:39:51.500959 11459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:51.501261 11459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:51.502434 11459 hybrid_clock.cc:648] HybridClock initialized: now 1786199991502416 us; error 43 us; skew 500 ppm
Aug 08 14:39:51 dist-test-slave-8n49 krb5kdc[11444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199991, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:51.504896 11459 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:51.505323 11459 webserver.cc:460] Webserver started at http://127.0.0.1:38421/ using document root <none> and password file <none>
I20260808 14:39:51.505591 11459 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:51.505662 11459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:51.505812 11459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:51.506863 11459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "c2411f0682ae483884681c69a9857389"
format_stamp: "Formatted at 2026-08-08 14:39:51 on dist-test-slave-8n49"
server_key: "65d698cca10c84dd0781ec2b59d882dd"
server_key_iv: "cda7d34736744b785378e7bb7c580630"
server_key_version: "encryptionkey@0"
I20260808 14:39:51.507231 11459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "c2411f0682ae483884681c69a9857389"
format_stamp: "Formatted at 2026-08-08 14:39:51 on dist-test-slave-8n49"
server_key: "65d698cca10c84dd0781ec2b59d882dd"
server_key_iv: "cda7d34736744b785378e7bb7c580630"
server_key_version: "encryptionkey@0"
I20260808 14:39:51.508600 11459 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260808 14:39:51.509302 11475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:51.509454 11459 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:51.509569 11459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "c2411f0682ae483884681c69a9857389"
format_stamp: "Formatted at 2026-08-08 14:39:51 on dist-test-slave-8n49"
server_key: "65d698cca10c84dd0781ec2b59d882dd"
server_key_iv: "cda7d34736744b785378e7bb7c580630"
server_key_version: "encryptionkey@0"
I20260808 14:39:51.509658 11459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:51.525496 11459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:51.527390 11459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:51.527557 11459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:51.531838 11459 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46439
I20260808 14:39:51.531891 11533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46439 every 8 connection(s)
I20260808 14:39:51.532269 11459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:51.533285 11534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:51.535607 11534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389: Bootstrap starting.
I20260808 14:39:51.535895 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 11459
I20260808 14:39:51.536051 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:51.536263 20804 external_mini_cluster.cc:1428] Setting key 4ffcb2e68b26aef72dabc60173f2a8f7
I20260808 14:39:51.536289 11534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:51.537146 11534 log.cc:824] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:51.537902 11534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389: No bootstrap required, opened a new log
I20260808 14:39:51.540043 11534 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2411f0682ae483884681c69a9857389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46439 } }
I20260808 14:39:51.540230 11534 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:51.540257 11534 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2411f0682ae483884681c69a9857389, State: Initialized, Role: FOLLOWER
I20260808 14:39:51.540402 11534 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2411f0682ae483884681c69a9857389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46439 } }
I20260808 14:39:51.540479 11534 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:51.540500 11534 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:51.540594 11534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:51.541347 11534 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2411f0682ae483884681c69a9857389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46439 } }
I20260808 14:39:51.541471 11534 leader_election.cc:302] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2411f0682ae483884681c69a9857389; no voters:
I20260808 14:39:51.541642 11534 leader_election.cc:288] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:51.541666 11539 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:51.541775 11539 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [term 1 LEADER]: Becoming Leader. State: Replica: c2411f0682ae483884681c69a9857389, State: Running, Role: LEADER
I20260808 14:39:51.541905 11534 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:51.541915 11539 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2411f0682ae483884681c69a9857389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46439 } }
I20260808 14:39:51.542306 11539 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2411f0682ae483884681c69a9857389. Latest consensus state: current_term: 1 leader_uuid: "c2411f0682ae483884681c69a9857389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2411f0682ae483884681c69a9857389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46439 } } }
I20260808 14:39:51.542374 11539 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:51.542572 11537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:51.536851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:49809 (local address 127.0.0.1:46439)
0808 14:39:51.537044 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:51.537060 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:51.537089 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:39:51.537580 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:51.537587 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:51.537637 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:51.537755 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:51.538043 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:51.538927 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:51.540101 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:51.540718 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:51.540809 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:51.541516 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:51.541520 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:51.541520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:51.541752 (+ 232us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:51.541797 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:51.541815 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:51.541934 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:51.542112 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 14:39:51.542161 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
I20260808 14:39:51.542636 11541 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2411f0682ae483884681c69a9857389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2411f0682ae483884681c69a9857389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46439 } } }
I20260808 14:39:51.542913 11541 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:51.543802 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 14:39:51.544369 11558 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:39:51.545210 11558 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:39:51.545285 11545 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:51.545534 11545 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:51.547427 11545 catalog_manager.cc:1347] Generated new cluster ID: 8d285d52ff11427ab9b53059891e426d
I20260808 14:39:51.547479 11545 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:51.549038 11537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:51.545171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:33073 (local address 127.0.0.1:46439)
0808 14:39:51.545207 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:51.545208 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:51.545317 (+ 109us) server_negotiation.cc:407] Connection header received
0808 14:39:51.545415 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:51.545416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:51.545440 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:51.545474 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:51.545687 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:51.546536 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:51.547583 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:51.547888 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:51.547930 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:51.548754 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:51.548755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:51.548756 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:51.548760 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:51.548774 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:51.548778 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:51.548811 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:51.548953 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:39:51.548965 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:39:51.561039 11545 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:51.561589 11545 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:51.569399 11545 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2411f0682ae483884681c69a9857389: Generated new TSK 0
I20260808 14:39:51.569636 11545 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:51.578269 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 11459
W20260808 14:39:51.585398 11442 connection.cc:535] client connection to 127.0.0.1:46439 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46439): Connection reset by peer (error 104)
2026-08-08T14:39:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1371 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:51 dist-test-slave-8n49 krb5kdc[11569](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:51 dist-test-slave-8n49 krb5kdc[11569](info): set up 2 sockets
Aug 08 14:39:51 dist-test-slave-8n49 krb5kdc[11569](info): commencing operation
krb5kdc: starting...
W20260808 14:39:52.728191 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:52 dist-test-slave-8n49 krb5kdc[11569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:39:52.850945 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42631
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:52.935139 11585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:52.935344 11585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:52.935366 11585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:52.936542 11585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:52.936611 11585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:52.936626 11585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:52.936638 11585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:52.936650 11585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:52.938066 11585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42631
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:52.938262 11585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:52.938439 11585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:52.943305 11590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:52.943266 11594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:52.943266 11591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:52.943499 11585 server_base.cc:1034] running on GCE node
I20260808 14:39:52.943831 11585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:52.944072 11585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:52.945209 11585 hybrid_clock.cc:648] HybridClock initialized: now 1786199992945198 us; error 28 us; skew 500 ppm
Aug 08 14:39:52 dist-test-slave-8n49 krb5kdc[11569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199992, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:52.947734 11585 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:39:52.948210 11585 webserver.cc:460] Webserver started at http://127.0.0.1:33613/ using document root <none> and password file <none>
I20260808 14:39:52.948441 11585 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:52.948509 11585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:52.948689 11585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:52.949784 11585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "06dd3a20906740fca0308b00432924d2"
format_stamp: "Formatted at 2026-08-08 14:39:52 on dist-test-slave-8n49"
server_key: "85c852c2735a3a6d7a511b1ad17f123e"
server_key_iv: "bea33e7e6e2505f948c1f68dd37232df"
server_key_version: "encryptionkey@0"
I20260808 14:39:52.950160 11585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "06dd3a20906740fca0308b00432924d2"
format_stamp: "Formatted at 2026-08-08 14:39:52 on dist-test-slave-8n49"
server_key: "85c852c2735a3a6d7a511b1ad17f123e"
server_key_iv: "bea33e7e6e2505f948c1f68dd37232df"
server_key_version: "encryptionkey@0"
I20260808 14:39:52.951506 11585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:52.952272 11601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:52.952463 11585 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:52.952596 11585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "06dd3a20906740fca0308b00432924d2"
format_stamp: "Formatted at 2026-08-08 14:39:52 on dist-test-slave-8n49"
server_key: "85c852c2735a3a6d7a511b1ad17f123e"
server_key_iv: "bea33e7e6e2505f948c1f68dd37232df"
server_key_version: "encryptionkey@0"
I20260808 14:39:52.952678 11585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:52.957265 11585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:52.959594 11585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:52.959751 11585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:52.964224 11585 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42631
I20260808 14:39:52.964254 11656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42631 every 8 connection(s)
I20260808 14:39:52.964670 11585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:52.965616 11657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:52.966127 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 11585
I20260808 14:39:52.966218 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:52.966435 20804 external_mini_cluster.cc:1428] Setting key afe278e859701047507b3130fb553814
I20260808 14:39:52.968881 11657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2: Bootstrap starting.
I20260808 14:39:52.969120 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:52.966979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:38489 (local address 127.0.0.1:42631)
0808 14:39:52.967172 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:52.967182 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:52.967216 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:39:52.967762 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:52.967772 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:52.967806 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:52.967966 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:52.968613 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:52.968617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:52.968617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:52.968622 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:52.968666 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:52.968681 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:52.968764 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:52.968801 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 14:39:52.968943 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
I20260808 14:39:52.969626 11657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:52.969976 11657 log.cc:824] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:52.970192 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:52.970678 11657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2: No bootstrap required, opened a new log
I20260808 14:39:52.972807 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:52.971644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:46281 (local address 127.0.0.1:42631)
0808 14:39:52.971684 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:52.971686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:52.971810 (+ 124us) server_negotiation.cc:407] Connection header received
0808 14:39:52.971866 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:52.971867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:52.971871 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:52.971938 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:52.972501 (+ 563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:52.972503 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:52.972504 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:52.972509 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:52.972526 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:52.972586 (+ 60us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:52.972660 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:52.972711 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 14:39:52.972726 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:39:52.973102 11657 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06dd3a20906740fca0308b00432924d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42631 } }
I20260808 14:39:52.973291 11657 raft_consensus.cc:374] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:52.973342 11657 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06dd3a20906740fca0308b00432924d2, State: Initialized, Role: FOLLOWER
I20260808 14:39:52.973433 11657 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06dd3a20906740fca0308b00432924d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42631 } }
I20260808 14:39:52.973496 11657 raft_consensus.cc:388] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:52.973518 11657 raft_consensus.cc:482] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:52.973546 11657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:52.974048 11657 raft_consensus.cc:504] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06dd3a20906740fca0308b00432924d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42631 } }
I20260808 14:39:52.974133 11657 leader_election.cc:302] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06dd3a20906740fca0308b00432924d2; no voters:
I20260808 14:39:52.974251 11657 leader_election.cc:288] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:52.974304 11671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:52.974466 11671 raft_consensus.cc:686] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [term 1 LEADER]: Becoming Leader. State: Replica: 06dd3a20906740fca0308b00432924d2, State: Running, Role: LEADER
I20260808 14:39:52.974510 11657 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:52.974617 11671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06dd3a20906740fca0308b00432924d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42631 } }
I20260808 14:39:52.974987 11672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06dd3a20906740fca0308b00432924d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06dd3a20906740fca0308b00432924d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42631 } } }
I20260808 14:39:52.974992 11673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06dd3a20906740fca0308b00432924d2. Latest consensus state: current_term: 1 leader_uuid: "06dd3a20906740fca0308b00432924d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06dd3a20906740fca0308b00432924d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42631 } } }
I20260808 14:39:52.975116 11672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:52.975123 11673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:52.975353 11680 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:52.975957 11680 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:52.977526 11680 catalog_manager.cc:1347] Generated new cluster ID: b273a5d2133048f8bd4b2f9e111ecafe
I20260808 14:39:52.977578 11680 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:52.993824 11680 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:52.994006 11680 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:52.996688 11680 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 06dd3a20906740fca0308b00432924d2: Generated new TSK 0
I20260808 14:39:52.996865 11680 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:53.007601 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 11585
2026-08-08T14:39:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1428 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:53 dist-test-slave-8n49 krb5kdc[11694](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:53 dist-test-slave-8n49 krb5kdc[11694](info): set up 2 sockets
Aug 08 14:39:53 dist-test-slave-8n49 krb5kdc[11694](info): commencing operation
krb5kdc: starting...
W20260808 14:39:54.084847 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:54 dist-test-slave-8n49 krb5kdc[11694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:39:54.207723 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:45027
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:41099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:45027
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:54.290717 11707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:54.290956 11707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:54.290995 11707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:54.292166 11707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:54.292236 11707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:54.292263 11707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:54.292295 11707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:54.292318 11707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:54.293918 11707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:41099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:45027
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:45027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:54.294203 11707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:54.294435 11707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:54.299719 11713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:54.299801 11707 server_base.cc:1034] running on GCE node
W20260808 14:39:54.299714 11715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:54.299714 11712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:54.300170 11707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:54.300472 11707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:54.301617 11707 hybrid_clock.cc:648] HybridClock initialized: now 1786199994301596 us; error 34 us; skew 500 ppm
Aug 08 14:39:54 dist-test-slave-8n49 krb5kdc[11694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199994, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:54.304044 11707 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:39:54.304536 11707 webserver.cc:460] Webserver started at http://127.20.81.62:46183/ using document root <none> and password file <none>
I20260808 14:39:54.304844 11707 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:54.304915 11707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:54.305066 11707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:54.306139 11707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "8ae54cc2814c4a16bffac8949e94db92"
format_stamp: "Formatted at 2026-08-08 14:39:54 on dist-test-slave-8n49"
server_key: "c5ab57f8cfbb89bacdc43766185ab386"
server_key_iv: "2ba2b1a8704094eece5fee028710373e"
server_key_version: "encryptionkey@0"
I20260808 14:39:54.306499 11707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "8ae54cc2814c4a16bffac8949e94db92"
format_stamp: "Formatted at 2026-08-08 14:39:54 on dist-test-slave-8n49"
server_key: "c5ab57f8cfbb89bacdc43766185ab386"
server_key_iv: "2ba2b1a8704094eece5fee028710373e"
server_key_version: "encryptionkey@0"
I20260808 14:39:54.307858 11707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:39:54.308630 11723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:54.308815 11707 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:39:54.308918 11707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "8ae54cc2814c4a16bffac8949e94db92"
format_stamp: "Formatted at 2026-08-08 14:39:54 on dist-test-slave-8n49"
server_key: "c5ab57f8cfbb89bacdc43766185ab386"
server_key_iv: "2ba2b1a8704094eece5fee028710373e"
server_key_version: "encryptionkey@0"
I20260808 14:39:54.309005 11707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:54.317592 11707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:54.319391 11707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:54.319564 11707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:54.323858 11707 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:45027
I20260808 14:39:54.323906 11779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:45027 every 8 connection(s)
I20260808 14:39:54.324285 11707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:54.325205 11780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:54.327539 11780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92: Bootstrap starting.
I20260808 14:39:54.328157 11780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:54.328466 11780 log.cc:824] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:54.329205 11780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92: No bootstrap required, opened a new log
I20260808 14:39:54.330827 11780 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae54cc2814c4a16bffac8949e94db92" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45027 } }
I20260808 14:39:54.330969 11780 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:54.330992 11780 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae54cc2814c4a16bffac8949e94db92, State: Initialized, Role: FOLLOWER
I20260808 14:39:54.331176 11780 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae54cc2814c4a16bffac8949e94db92" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45027 } }
I20260808 14:39:54.331241 11780 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:54.331264 11780 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:54.331332 11780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:54.332178 11780 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae54cc2814c4a16bffac8949e94db92" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45027 } }
I20260808 14:39:54.332294 11780 leader_election.cc:302] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ae54cc2814c4a16bffac8949e94db92; no voters:
I20260808 14:39:54.332504 11780 leader_election.cc:288] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:54.332592 11783 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:54.332758 11783 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [term 1 LEADER]: Becoming Leader. State: Replica: 8ae54cc2814c4a16bffac8949e94db92, State: Running, Role: LEADER
I20260808 14:39:54.332831 11780 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:54.332811 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 11707
I20260808 14:39:54.332883 11783 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae54cc2814c4a16bffac8949e94db92" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45027 } }
I20260808 14:39:54.332963 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:54.333194 20804 external_mini_cluster.cc:1428] Setting key ef817dd2e591a390e7ee1d4c327099ac
I20260808 14:39:54.333329 11785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ae54cc2814c4a16bffac8949e94db92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae54cc2814c4a16bffac8949e94db92" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45027 } } }
I20260808 14:39:54.333341 11786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ae54cc2814c4a16bffac8949e94db92. Latest consensus state: current_term: 1 leader_uuid: "8ae54cc2814c4a16bffac8949e94db92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae54cc2814c4a16bffac8949e94db92" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45027 } } }
I20260808 14:39:54.333429 11785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:54.333434 11786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:54.333757 11791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:54.334604 11791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:54.336252 11791 catalog_manager.cc:1347] Generated new cluster ID: 55b2542595024818a031f5938216941d
I20260808 14:39:54.336305 11791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:39:54 dist-test-slave-8n49 krb5kdc[11694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:54.344098 11795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:54.333905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56277 (local address 127.20.81.62:45027)
0808 14:39:54.334289 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:54.334300 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:54.334336 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:39:54.334472 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:54.334480 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:54.334567 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:54.335650 (+ 1083us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:54.335789 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:54.336941 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:54.337714 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:54.338149 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:54.338280 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:54.340675 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:54.340679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:54.340679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:54.340699 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:54.342392 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:54.342828 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:54.342831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:54.342832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:54.342966 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:54.343226 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:54.343227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:54.343227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:54.343481 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:54.343694 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:54.343785 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 14:39:54.343895 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":71,"threads_started":1}
I20260808 14:39:54.345268 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:54.359031 11795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:54.346654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53593 (local address 127.20.81.62:45027)
0808 14:39:54.346692 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:54.346694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:54.352741 (+ 6047us) server_negotiation.cc:407] Connection header received
0808 14:39:54.352821 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:54.352822 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:54.352833 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:54.352905 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:54.353471 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:54.354117 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:54.354837 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:54.355043 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:54.355123 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:54.356376 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:54.356377 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:54.356378 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:54.356385 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:54.357810 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:54.358196 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:54.358197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:54.358198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:54.358259 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:54.358487 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:54.358488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:54.358489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:54.358608 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:54.358725 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:54.358853 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 14:39:54.358918 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:39:54.368883 11791 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:54.369488 11791 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:54.398243 11791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ae54cc2814c4a16bffac8949e94db92: Generated new TSK 0
I20260808 14:39:54.398478 11791 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:54.403296 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 11707
W20260808 14:39:54.410615 11692 connection.cc:535] client connection to 127.20.81.62:45027 recv error: Network error: failed to read from TLS socket (remote: 127.20.81.62:45027): Connection reset by peer (error 104)
2026-08-08T14:39:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1396 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:54 dist-test-slave-8n49 krb5kdc[11814](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:54 dist-test-slave-8n49 krb5kdc[11814](info): set up 2 sockets
Aug 08 14:39:54 dist-test-slave-8n49 krb5kdc[11814](info): commencing operation
krb5kdc: starting...
W20260808 14:39:55.480501 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:55 dist-test-slave-8n49 krb5kdc[11814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:39:55.604246 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33389
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:33389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:55.689090 11829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:55.689303 11829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:55.689327 11829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:55.690569 11829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:55.690618 11829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:55.690631 11829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:55.690644 11829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:55.690656 11829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:55.692173 11829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:33389
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:33389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:55.692461 11829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:55.692728 11829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:55.697645 11834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:55.697705 11837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:55.697780 11829 server_base.cc:1034] running on GCE node
W20260808 14:39:55.697681 11835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:55.698119 11829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:55.698424 11829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:55.699601 11829 hybrid_clock.cc:648] HybridClock initialized: now 1786199995699597 us; error 66 us; skew 500 ppm
Aug 08 14:39:55 dist-test-slave-8n49 krb5kdc[11814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199995, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:55.706800 11829 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:39:55.707283 11829 webserver.cc:460] Webserver started at http://127.20.81.62:36639/ using document root <none> and password file <none>
I20260808 14:39:55.707520 11829 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:55.707592 11829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:55.707757 11829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:55.708956 11829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "b530c0acf5a74546ac170313ed326737"
format_stamp: "Formatted at 2026-08-08 14:39:55 on dist-test-slave-8n49"
server_key: "e3c4787b18806147b2e5d11b4ad1bb1c"
server_key_iv: "f5440e4dade29f0f5782a7ddadd202fc"
server_key_version: "encryptionkey@0"
I20260808 14:39:55.709340 11829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "b530c0acf5a74546ac170313ed326737"
format_stamp: "Formatted at 2026-08-08 14:39:55 on dist-test-slave-8n49"
server_key: "e3c4787b18806147b2e5d11b4ad1bb1c"
server_key_iv: "f5440e4dade29f0f5782a7ddadd202fc"
server_key_version: "encryptionkey@0"
I20260808 14:39:55.710765 11829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:39:55.711606 11846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:55.711884 11829 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:55.712033 11829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "b530c0acf5a74546ac170313ed326737"
format_stamp: "Formatted at 2026-08-08 14:39:55 on dist-test-slave-8n49"
server_key: "e3c4787b18806147b2e5d11b4ad1bb1c"
server_key_iv: "f5440e4dade29f0f5782a7ddadd202fc"
server_key_version: "encryptionkey@0"
I20260808 14:39:55.712127 11829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:55.721155 11829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:55.722993 11829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:55.723165 11829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:55.727659 11829 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:33389
I20260808 14:39:55.727721 11905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:33389 every 8 connection(s)
I20260808 14:39:55.728077 11829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:55.729086 11906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:55.730329 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 11829
I20260808 14:39:55.730468 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:55.730706 20804 external_mini_cluster.cc:1428] Setting key c9ee525132aa4b6d98cffb3160fb9136
I20260808 14:39:55.732034 11906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737: Bootstrap starting.
I20260808 14:39:55.732829 11906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:55.733127 11906 log.cc:824] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:55.733851 11906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737: No bootstrap required, opened a new log
I20260808 14:39:55.735917 11906 raft_consensus.cc:348] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b530c0acf5a74546ac170313ed326737" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33389 } }
I20260808 14:39:55.736086 11906 raft_consensus.cc:374] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:55.736182 11906 raft_consensus.cc:729] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b530c0acf5a74546ac170313ed326737, State: Initialized, Role: FOLLOWER
I20260808 14:39:55.736351 11906 consensus_queue.cc:260] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b530c0acf5a74546ac170313ed326737" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33389 } }
I20260808 14:39:55.736451 11906 raft_consensus.cc:388] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:55.736519 11906 raft_consensus.cc:482] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:55.736593 11906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:55.736666 11909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:55.731259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42379 (local address 127.20.81.62:33389)
0808 14:39:55.731462 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:55.731472 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:55.731508 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:39:55.731957 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:55.731963 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:55.732012 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:55.732181 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:55.732453 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:55.733539 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:55.734416 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:55.734841 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:55.734964 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:55.735802 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:55.735806 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:55.735807 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:55.735972 (+ 165us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:55.736003 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:55.736014 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:55.736112 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:55.736245 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 14:39:55.736380 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260808 14:39:55.737380 11906 raft_consensus.cc:504] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b530c0acf5a74546ac170313ed326737" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33389 } }
I20260808 14:39:55.737512 11906 leader_election.cc:302] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b530c0acf5a74546ac170313ed326737; no voters:
I20260808 14:39:55.737702 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:55.737716 11906 leader_election.cc:288] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:55.737739 11911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:55.737855 11911 raft_consensus.cc:686] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [term 1 LEADER]: Becoming Leader. State: Replica: b530c0acf5a74546ac170313ed326737, State: Running, Role: LEADER
I20260808 14:39:55.737985 11906 sys_catalog.cc:564] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:55.737996 11911 consensus_queue.cc:237] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b530c0acf5a74546ac170313ed326737" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33389 } }
I20260808 14:39:55.738479 11913 sys_catalog.cc:455] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b530c0acf5a74546ac170313ed326737. Latest consensus state: current_term: 1 leader_uuid: "b530c0acf5a74546ac170313ed326737" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b530c0acf5a74546ac170313ed326737" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33389 } } }
I20260808 14:39:55.738575 11913 sys_catalog.cc:458] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:55.738826 11914 sys_catalog.cc:455] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b530c0acf5a74546ac170313ed326737" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b530c0acf5a74546ac170313ed326737" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 33389 } } }
I20260808 14:39:55.739161 11914 sys_catalog.cc:458] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:55.739423 11920 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:55.740015 11920 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:55.742151 11920 catalog_manager.cc:1347] Generated new cluster ID: 94e7404c59134d7dbd996caed5ba1637
I20260808 14:39:55.742252 11920 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:55.742556 11909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:55.739269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50077 (local address 127.20.81.62:33389)
0808 14:39:55.739304 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:55.739306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:55.739417 (+ 111us) server_negotiation.cc:407] Connection header received
0808 14:39:55.739509 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:55.739510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:55.739519 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:55.739550 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:55.739832 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:55.740310 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:55.741213 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:55.741460 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:55.741536 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:55.742234 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:55.742235 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:55.742236 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:55.742240 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:55.742254 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:55.742258 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:55.742315 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:55.742451 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:39:55.742462 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:39:55.772686 11920 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:55.773272 11920 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:55.776507 11920 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b530c0acf5a74546ac170313ed326737: Generated new TSK 0
I20260808 14:39:55.776736 11920 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:55.781251 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 11829
W20260808 14:39:55.788149 11811 connection.cc:535] client connection to 127.20.81.62:33389 recv error: Network error: failed to read from TLS socket (remote: 127.20.81.62:33389): Connection reset by peer (error 104)
2026-08-08T14:39:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1377 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:55 dist-test-slave-8n49 krb5kdc[11941](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:55 dist-test-slave-8n49 krb5kdc[11941](info): set up 2 sockets
Aug 08 14:39:55 dist-test-slave-8n49 krb5kdc[11941](info): commencing operation
krb5kdc: starting...
W20260808 14:39:56.861548 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:56 dist-test-slave-8n49 krb5kdc[11941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:39:56.991786 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40593
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:42089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:40593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:57.074913 11956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:57.075181 11956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:57.075225 11956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:57.076408 11956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:57.076485 11956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:57.076511 11956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:57.076539 11956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:57.076558 11956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:57.078172 11956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:40593
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:57.078462 11956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:57.078706 11956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:57.083629 11965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:57.083612 11962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:57.083709 11963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:57.084025 11956 server_base.cc:1034] running on GCE node
I20260808 14:39:57.084328 11956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:57.084710 11956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:57.085906 11956 hybrid_clock.cc:648] HybridClock initialized: now 1786199997085891 us; error 41 us; skew 500 ppm
Aug 08 14:39:57 dist-test-slave-8n49 krb5kdc[11941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199997, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:57.088837 11956 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:39:57.089335 11956 webserver.cc:460] Webserver started at http://127.20.81.62:36413/ using document root <none> and password file <none>
I20260808 14:39:57.089597 11956 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:57.089676 11956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:57.089850 11956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:57.091063 11956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "ba520b84f1fb4d109137505e9103b993"
format_stamp: "Formatted at 2026-08-08 14:39:57 on dist-test-slave-8n49"
server_key: "29660a61c4559aa855e1ef87121ecae0"
server_key_iv: "55ddf6546a6314a44ff1fde4c31938d4"
server_key_version: "encryptionkey@0"
I20260808 14:39:57.091488 11956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "ba520b84f1fb4d109137505e9103b993"
format_stamp: "Formatted at 2026-08-08 14:39:57 on dist-test-slave-8n49"
server_key: "29660a61c4559aa855e1ef87121ecae0"
server_key_iv: "55ddf6546a6314a44ff1fde4c31938d4"
server_key_version: "encryptionkey@0"
I20260808 14:39:57.093389 11956 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 14:39:57.094269 11973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:57.094513 11956 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:57.094785 11956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "ba520b84f1fb4d109137505e9103b993"
format_stamp: "Formatted at 2026-08-08 14:39:57 on dist-test-slave-8n49"
server_key: "29660a61c4559aa855e1ef87121ecae0"
server_key_iv: "55ddf6546a6314a44ff1fde4c31938d4"
server_key_version: "encryptionkey@0"
I20260808 14:39:57.094908 11956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:57.098553 11956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:57.100857 11956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:57.101038 11956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:57.105868 11956 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:40593
I20260808 14:39:57.105904 12029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:40593 every 8 connection(s)
I20260808 14:39:57.106285 11956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:57.106884 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 11956
I20260808 14:39:57.107031 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:57.107229 20804 external_mini_cluster.cc:1428] Setting key 034c204bee7fb0827fcbc5ad3834e0ca
I20260808 14:39:57.107508 12030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:57.110495 12033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:57.107816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44923 (local address 127.20.81.62:40593)
0808 14:39:57.108051 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:57.108062 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:57.108112 (+ 50us) server_negotiation.cc:407] Connection header received
0808 14:39:57.109104 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:57.109114 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:57.109145 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:57.109314 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:57.110056 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:57.110060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:57.110060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:57.110065 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:57.110106 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:57.110117 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:57.110204 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:57.110282 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:39:57.110329 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":99,"threads_started":1}
I20260808 14:39:57.110891 12030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993: Bootstrap starting.
I20260808 14:39:57.111625 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:57.111723 12030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:57.111999 12030 log.cc:824] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:57.112850 12030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993: No bootstrap required, opened a new log
I20260808 14:39:57.114204 12033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:57.113188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42141 (local address 127.20.81.62:40593)
0808 14:39:57.113227 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:57.113230 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:57.113355 (+ 125us) server_negotiation.cc:407] Connection header received
0808 14:39:57.113385 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:57.113385 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:57.113390 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:57.113468 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:57.114005 (+ 537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:57.114007 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:57.114007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:57.114011 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:57.114028 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:57.114032 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:57.114097 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:57.114132 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 14:39:57.114145 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:39:57.115258 12030 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba520b84f1fb4d109137505e9103b993" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40593 } }
I20260808 14:39:57.115418 12030 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:57.115471 12030 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba520b84f1fb4d109137505e9103b993, State: Initialized, Role: FOLLOWER
I20260808 14:39:57.115593 12030 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba520b84f1fb4d109137505e9103b993" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40593 } }
I20260808 14:39:57.115685 12030 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:57.115731 12030 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:57.115780 12030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:57.116317 12030 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba520b84f1fb4d109137505e9103b993" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40593 } }
I20260808 14:39:57.116438 12030 leader_election.cc:302] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba520b84f1fb4d109137505e9103b993; no voters:
I20260808 14:39:57.116611 12030 leader_election.cc:288] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:57.116679 12040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:57.116854 12040 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [term 1 LEADER]: Becoming Leader. State: Replica: ba520b84f1fb4d109137505e9103b993, State: Running, Role: LEADER
I20260808 14:39:57.116905 12030 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:57.117028 12040 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba520b84f1fb4d109137505e9103b993" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40593 } }
I20260808 14:39:57.117412 12041 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba520b84f1fb4d109137505e9103b993" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba520b84f1fb4d109137505e9103b993" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40593 } } }
I20260808 14:39:57.117414 12042 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba520b84f1fb4d109137505e9103b993. Latest consensus state: current_term: 1 leader_uuid: "ba520b84f1fb4d109137505e9103b993" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba520b84f1fb4d109137505e9103b993" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40593 } } }
I20260808 14:39:57.117607 12041 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:57.117628 12042 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:57.118070 12050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:57.118570 12050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:57.120236 12050 catalog_manager.cc:1347] Generated new cluster ID: 3c1ae612419344c09d00572af5b648f5
I20260808 14:39:57.120292 12050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:57.136191 12050 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:57.136386 12050 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:57.139744 12050 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba520b84f1fb4d109137505e9103b993: Generated new TSK 0
I20260808 14:39:57.139948 12050 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:57.147979 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 11956
2026-08-08T14:39:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1366 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:57 dist-test-slave-8n49 krb5kdc[12062](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:57 dist-test-slave-8n49 krb5kdc[12062](info): set up 2 sockets
Aug 08 14:39:57 dist-test-slave-8n49 krb5kdc[12062](info): commencing operation
krb5kdc: starting...
W20260808 14:39:58.236405 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:58 dist-test-slave-8n49 krb5kdc[12062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:39:58.359900 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40157
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:42583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:40157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:58.444619 12075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:58.445004 12075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:58.445080 12075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:58.446290 12075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:58.446332 12075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:58.446347 12075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:58.446360 12075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:58.446378 12075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:58.447902 12075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:42583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:40157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:58.448118 12075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:58.448297 12075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:58.453454 12081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:58.453440 12080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:58.453538 12083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:58.453835 12075 server_base.cc:1034] running on GCE node
I20260808 14:39:58.454166 12075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:58.454512 12075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:58.455696 12075 hybrid_clock.cc:648] HybridClock initialized: now 1786199998455678 us; error 36 us; skew 500 ppm
Aug 08 14:39:58 dist-test-slave-8n49 krb5kdc[12062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199998, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:58.458350 12075 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:39:58.458884 12075 webserver.cc:460] Webserver started at http://127.20.81.62:34997/ using document root <none> and password file <none>
I20260808 14:39:58.459134 12075 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:58.459206 12075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:58.459363 12075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:58.460469 12075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "1780f932603d47a5a4033a91a98a4637"
format_stamp: "Formatted at 2026-08-08 14:39:58 on dist-test-slave-8n49"
server_key: "8cdc607a2980a3a9ddda539f795f49a6"
server_key_iv: "d9775abbe15c170e32317192d9489c7b"
server_key_version: "encryptionkey@0"
I20260808 14:39:58.460927 12075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "1780f932603d47a5a4033a91a98a4637"
format_stamp: "Formatted at 2026-08-08 14:39:58 on dist-test-slave-8n49"
server_key: "8cdc607a2980a3a9ddda539f795f49a6"
server_key_iv: "d9775abbe15c170e32317192d9489c7b"
server_key_version: "encryptionkey@0"
I20260808 14:39:58.462301 12075 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:39:58.463014 12091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:58.463204 12075 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:58.463310 12075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "1780f932603d47a5a4033a91a98a4637"
format_stamp: "Formatted at 2026-08-08 14:39:58 on dist-test-slave-8n49"
server_key: "8cdc607a2980a3a9ddda539f795f49a6"
server_key_iv: "d9775abbe15c170e32317192d9489c7b"
server_key_version: "encryptionkey@0"
I20260808 14:39:58.463397 12075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:58.492514 12075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:58.494699 12075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:58.494876 12075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:58.499265 12075 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:40157
I20260808 14:39:58.499336 12146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:40157 every 8 connection(s)
I20260808 14:39:58.499702 12075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:58.500648 12147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:58.502996 12147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637: Bootstrap starting.
I20260808 14:39:58.503552 12147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:58.503804 12147 log.cc:824] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:58.504504 12147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637: No bootstrap required, opened a new log
I20260808 14:39:58.505499 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 12075
I20260808 14:39:58.505642 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:58.505836 20804 external_mini_cluster.cc:1428] Setting key a6f64a5003aa8983f7f079b55375638c
I20260808 14:39:58.506503 12147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1780f932603d47a5a4033a91a98a4637" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40157 } }
I20260808 14:39:58.506712 12147 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:58.506767 12147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1780f932603d47a5a4033a91a98a4637, State: Initialized, Role: FOLLOWER
I20260808 14:39:58.506906 12147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1780f932603d47a5a4033a91a98a4637" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40157 } }
I20260808 14:39:58.507004 12147 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:58.507041 12147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:58.507139 12147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:58.507915 12147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1780f932603d47a5a4033a91a98a4637" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40157 } }
I20260808 14:39:58.508014 12147 leader_election.cc:302] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1780f932603d47a5a4033a91a98a4637; no voters:
I20260808 14:39:58.508221 12147 leader_election.cc:288] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:58.508251 12152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:58.508363 12152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [term 1 LEADER]: Becoming Leader. State: Replica: 1780f932603d47a5a4033a91a98a4637, State: Running, Role: LEADER
I20260808 14:39:58.508502 12147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:58.508513 12152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1780f932603d47a5a4033a91a98a4637" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40157 } }
I20260808 14:39:58.508970 12154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1780f932603d47a5a4033a91a98a4637. Latest consensus state: current_term: 1 leader_uuid: "1780f932603d47a5a4033a91a98a4637" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1780f932603d47a5a4033a91a98a4637" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40157 } } }
I20260808 14:39:58.509054 12154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:58.509275 12153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1780f932603d47a5a4033a91a98a4637" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1780f932603d47a5a4033a91a98a4637" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40157 } } }
I20260808 14:39:58.509619 12153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637 [sys.catalog]: This master's current role is: LEADER
W20260808 14:39:58.510635 12168 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:39:58.510692 12168 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:39:58.510747 12158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:58.510917 12158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:58.512954 12158 catalog_manager.cc:1347] Generated new cluster ID: 506c49f79b0b45068b17d92d90cca57e
I20260808 14:39:58.513012 12158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:39:58 dist-test-slave-8n49 krb5kdc[12062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:39:58.516865 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:58.506422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58351 (local address 127.20.81.62:40157)
0808 14:39:58.506621 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:58.506630 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:58.506660 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:39:58.506781 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:58.506789 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:58.506850 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:58.506975 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:58.507821 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:58.509132 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:58.510202 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:58.510671 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:58.510840 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:58.513618 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:58.513623 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:58.513623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:58.513635 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:58.515372 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:58.515715 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:58.515718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:58.515718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:58.515822 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:58.516007 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:58.516008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:58.516008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:58.516306 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:58.516435 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:58.516513 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:39:58.516665 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":111,"threads_started":1}
I20260808 14:39:58.517724 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:58.523844 12158 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:58.524497 12158 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:58.526757 12158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1780f932603d47a5a4033a91a98a4637: Generated new TSK 0
I20260808 14:39:58.526908 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:58.519193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39369 (local address 127.20.81.62:40157)
0808 14:39:58.519236 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:58.519238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:58.519306 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:39:58.519366 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:58.519367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:58.519377 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:58.519445 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:58.520052 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:58.520888 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:58.521867 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:58.522193 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:58.522271 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:58.523691 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:58.523692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:58.523693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:39:58.523700 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:58.525461 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:58.525883 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:58.525884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:58.525884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:58.525942 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:39:58.526160 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:39:58.526161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:39:58.526161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:39:58.526280 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:58.526351 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:58.526725 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 14:39:58.526823 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:39:58.527020 12158 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:58.528967 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 12075
2026-08-08T14:39:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1380 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:58 dist-test-slave-8n49 krb5kdc[12179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:58 dist-test-slave-8n49 krb5kdc[12179](info): set up 2 sockets
Aug 08 14:39:58 dist-test-slave-8n49 krb5kdc[12179](info): commencing operation
krb5kdc: starting...
W20260808 14:39:59.621230 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:39:59 dist-test-slave-8n49 krb5kdc[12179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:39:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:39:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:39:59.747893 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:45259
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:46125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:45259
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:39:59.832302 12195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:39:59.832531 12195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:39:59.832610 12195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:39:59.833876 12195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:39:59.833920 12195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:39:59.833935 12195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:39:59.833947 12195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:39:59.833959 12195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:39:59.835500 12195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:46125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:45259
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:45259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:39:59.835763 12195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:39:59.835999 12195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:39:59.841099 12202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:39:59.841101 12201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:59.841182 12195 server_base.cc:1034] running on GCE node
W20260808 14:39:59.841301 12204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:39:59.841576 12195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:39:59.841882 12195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:39:59.843070 12195 hybrid_clock.cc:648] HybridClock initialized: now 1786199999843062 us; error 37 us; skew 500 ppm
Aug 08 14:39:59 dist-test-slave-8n49 krb5kdc[12179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199999, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:39:59.845709 12195 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:39:59.846171 12195 webserver.cc:460] Webserver started at http://127.20.81.62:45557/ using document root <none> and password file <none>
I20260808 14:39:59.846381 12195 fs_manager.cc:359] Metadata directory not provided
I20260808 14:39:59.846421 12195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:39:59.846510 12195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:39:59.847522 12195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "301fca1b16d14df886cdd09dc28fa2b4"
format_stamp: "Formatted at 2026-08-08 14:39:59 on dist-test-slave-8n49"
server_key: "17f3ff7f925f507e896cdf3fb96959e4"
server_key_iv: "7fe3345a5a917ecb8eef28b926e04e8d"
server_key_version: "encryptionkey@0"
I20260808 14:39:59.847819 12195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "301fca1b16d14df886cdd09dc28fa2b4"
format_stamp: "Formatted at 2026-08-08 14:39:59 on dist-test-slave-8n49"
server_key: "17f3ff7f925f507e896cdf3fb96959e4"
server_key_iv: "7fe3345a5a917ecb8eef28b926e04e8d"
server_key_version: "encryptionkey@0"
I20260808 14:39:59.849200 12195 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:39:59.849895 12212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:39:59.850080 12195 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:39:59.850175 12195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "301fca1b16d14df886cdd09dc28fa2b4"
format_stamp: "Formatted at 2026-08-08 14:39:59 on dist-test-slave-8n49"
server_key: "17f3ff7f925f507e896cdf3fb96959e4"
server_key_iv: "7fe3345a5a917ecb8eef28b926e04e8d"
server_key_version: "encryptionkey@0"
I20260808 14:39:59.850234 12195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:39:59.865084 12195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:39:59.867004 12195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:39:59.867126 12195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:39:59.871191 12195 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:45259
I20260808 14:39:59.871264 12266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:45259 every 8 connection(s)
I20260808 14:39:59.871631 12195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:39:59.872640 12267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:39:59.873654 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 12195
I20260808 14:39:59.873788 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:39:59.873973 20804 external_mini_cluster.cc:1428] Setting key 3dd9d555b8757a54a346f515934373ce
I20260808 14:39:59.876044 12267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4: Bootstrap starting.
I20260808 14:39:59.876791 12267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4: Neither blocks nor log segments found. Creating new log.
I20260808 14:39:59.877121 12267 log.cc:824] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:39:59.877877 12267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4: No bootstrap required, opened a new log
I20260808 14:39:59.879655 12270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:59.874540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34993 (local address 127.20.81.62:45259)
0808 14:39:59.874739 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:59.874747 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:59.874773 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:39:59.875215 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:59.875222 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:59.875269 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:59.875383 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:59.875635 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:59.876645 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:59.877709 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:59.878166 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:59.878269 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:59.878970 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:59.878974 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:59.878974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:59.879152 (+ 178us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:59.879188 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:59.879199 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:59.879251 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:59.879365 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 14:39:59.879444 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
I20260808 14:39:59.880375 12267 raft_consensus.cc:348] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301fca1b16d14df886cdd09dc28fa2b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45259 } }
I20260808 14:39:59.880595 12267 raft_consensus.cc:374] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:39:59.880647 12267 raft_consensus.cc:729] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301fca1b16d14df886cdd09dc28fa2b4, State: Initialized, Role: FOLLOWER
I20260808 14:39:59.880801 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:39:59.880795 12267 consensus_queue.cc:260] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301fca1b16d14df886cdd09dc28fa2b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45259 } }
I20260808 14:39:59.880877 12267 raft_consensus.cc:388] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:39:59.880916 12267 raft_consensus.cc:482] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:39:59.880962 12267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:39:59.881703 12267 raft_consensus.cc:504] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301fca1b16d14df886cdd09dc28fa2b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45259 } }
I20260808 14:39:59.881820 12267 leader_election.cc:302] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 301fca1b16d14df886cdd09dc28fa2b4; no voters:
I20260808 14:39:59.882001 12267 leader_election.cc:288] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:39:59.882095 12274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:39:59.882273 12267 sys_catalog.cc:564] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:39:59.882284 12274 raft_consensus.cc:686] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [term 1 LEADER]: Becoming Leader. State: Replica: 301fca1b16d14df886cdd09dc28fa2b4, State: Running, Role: LEADER
I20260808 14:39:59.882740 12274 consensus_queue.cc:237] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301fca1b16d14df886cdd09dc28fa2b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45259 } }
I20260808 14:39:59.883387 12277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "301fca1b16d14df886cdd09dc28fa2b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301fca1b16d14df886cdd09dc28fa2b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45259 } } }
I20260808 14:39:59.883481 12277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:39:59.883961 12278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 301fca1b16d14df886cdd09dc28fa2b4. Latest consensus state: current_term: 1 leader_uuid: "301fca1b16d14df886cdd09dc28fa2b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301fca1b16d14df886cdd09dc28fa2b4" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 45259 } } }
I20260808 14:39:59.884056 12278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4 [sys.catalog]: This master's current role is: LEADER
W20260808 14:39:59.884204 12293 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:39:59.884260 12293 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:39:59.884497 12292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:39:59.884702 12292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:39:59.886108 12270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:39:59.882369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50211 (local address 127.20.81.62:45259)
0808 14:39:59.882422 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:39:59.882424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:39:59.882553 (+ 129us) server_negotiation.cc:407] Connection header received
0808 14:39:59.882631 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:39:59.882632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:39:59.882649 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:39:59.882709 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:39:59.882903 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:59.883681 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:59.884729 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:39:59.885028 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:39:59.885102 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:39:59.885858 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:39:59.885859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:39:59.885859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:39:59.885865 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:39:59.885881 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:39:59.885885 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:39:59.885947 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:39:59.886015 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 14:39:59.886037 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:39:59.886387 12292 catalog_manager.cc:1347] Generated new cluster ID: 03316bb845bb47c293fb99674b5113c8
I20260808 14:39:59.886430 12292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:39:59.893652 12292 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:39:59.894165 12292 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:39:59.903067 12292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 301fca1b16d14df886cdd09dc28fa2b4: Generated new TSK 0
I20260808 14:39:59.903283 12292 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:39:59.905674 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 12195
2026-08-08T14:39:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1376 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:39:59 dist-test-slave-8n49 krb5kdc[12300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:39:59 dist-test-slave-8n49 krb5kdc[12300](info): set up 2 sockets
Aug 08 14:39:59 dist-test-slave-8n49 krb5kdc[12300](info): commencing operation
krb5kdc: starting...
W20260808 14:40:01.015247 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:40:01 dist-test-slave-8n49 krb5kdc[12300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:40:01.139991 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40087
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:40087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:01.223237 12313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:01.223450 12313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:01.223474 12313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:01.224678 12313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:01.224717 12313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:01.224732 12313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:01.224745 12313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:01.224757 12313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:01.226220 12313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:40087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:40087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:01.226534 12313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:01.226783 12313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:01.231781 12322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:01.231914 12313 server_base.cc:1034] running on GCE node
W20260808 14:40:01.231791 12319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:01.231801 12320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:01.232267 12313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:01.232728 12313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:01.233901 12313 hybrid_clock.cc:648] HybridClock initialized: now 1786200001233889 us; error 30 us; skew 500 ppm
Aug 08 14:40:01 dist-test-slave-8n49 krb5kdc[12300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200001, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:01.240849 12313 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:40:01.241375 12313 webserver.cc:460] Webserver started at http://127.20.81.62:42389/ using document root <none> and password file <none>
I20260808 14:40:01.241619 12313 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:01.241691 12313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:01.241847 12313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:01.242959 12313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "26b85b7482044f9598c012ed52d20e47"
format_stamp: "Formatted at 2026-08-08 14:40:01 on dist-test-slave-8n49"
server_key: "7cefb6339c1dfa6e474d43557033563d"
server_key_iv: "5446d00f074ebed9b5cc3bc3694ab7ce"
server_key_version: "encryptionkey@0"
I20260808 14:40:01.243350 12313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "26b85b7482044f9598c012ed52d20e47"
format_stamp: "Formatted at 2026-08-08 14:40:01 on dist-test-slave-8n49"
server_key: "7cefb6339c1dfa6e474d43557033563d"
server_key_iv: "5446d00f074ebed9b5cc3bc3694ab7ce"
server_key_version: "encryptionkey@0"
I20260808 14:40:01.244892 12313 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:40:01.245677 12330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:01.245878 12313 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:01.245987 12313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "26b85b7482044f9598c012ed52d20e47"
format_stamp: "Formatted at 2026-08-08 14:40:01 on dist-test-slave-8n49"
server_key: "7cefb6339c1dfa6e474d43557033563d"
server_key_iv: "5446d00f074ebed9b5cc3bc3694ab7ce"
server_key_version: "encryptionkey@0"
I20260808 14:40:01.246081 12313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:01.249567 12313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:01.251510 12313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:01.251685 12313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:01.255986 12313 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:40087
I20260808 14:40:01.256039 12383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:40087 every 8 connection(s)
I20260808 14:40:01.256402 12313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:01.257470 12384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:01.259801 12384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47: Bootstrap starting.
I20260808 14:40:01.260351 12384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:01.260684 12384 log.cc:824] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:01.261406 12384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47: No bootstrap required, opened a new log
I20260808 14:40:01.262959 12384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b85b7482044f9598c012ed52d20e47" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40087 } }
I20260808 14:40:01.263103 12384 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:01.263125 12384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b85b7482044f9598c012ed52d20e47, State: Initialized, Role: FOLLOWER
I20260808 14:40:01.263279 12384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b85b7482044f9598c012ed52d20e47" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40087 } }
I20260808 14:40:01.263362 12384 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:01.263387 12384 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:01.263417 12384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:01.264230 12384 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b85b7482044f9598c012ed52d20e47" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40087 } }
I20260808 14:40:01.264318 12384 leader_election.cc:302] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26b85b7482044f9598c012ed52d20e47; no voters:
I20260808 14:40:01.264439 12384 leader_election.cc:288] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:01.264504 12387 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:01.264688 12387 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [term 1 LEADER]: Becoming Leader. State: Replica: 26b85b7482044f9598c012ed52d20e47, State: Running, Role: LEADER
I20260808 14:40:01.264741 12384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:01.264834 12387 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b85b7482044f9598c012ed52d20e47" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40087 } }
I20260808 14:40:01.265208 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 12313
I20260808 14:40:01.265329 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:40:01.265548 20804 external_mini_cluster.cc:1428] Setting key 56c59c19b637d0446d67697f5a197c17
I20260808 14:40:01.265511 12388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26b85b7482044f9598c012ed52d20e47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b85b7482044f9598c012ed52d20e47" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40087 } } }
I20260808 14:40:01.265604 12388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:01.265769 12389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26b85b7482044f9598c012ed52d20e47. Latest consensus state: current_term: 1 leader_uuid: "26b85b7482044f9598c012ed52d20e47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b85b7482044f9598c012ed52d20e47" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 40087 } } }
I20260808 14:40:01.265848 12389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:01.266041 12398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:01.266577 12398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:01.268090 12398 catalog_manager.cc:1347] Generated new cluster ID: 94405d148ef34f8c88d36d9a8fa4d8e7
I20260808 14:40:01.268143 12398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:01.268793 12408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:01.266100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45023 (local address 127.20.81.62:40087)
0808 14:40:01.267241 (+ 1141us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:01.267248 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:01.267272 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:40:01.267363 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:01.267368 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:01.267392 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:01.267551 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:01.268328 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:01.268332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:01.268332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:01.268337 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:01.268384 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:01.268398 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:01.268462 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:01.268581 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 14:40:01.268623 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1096,"thread_start_us":57,"threads_started":1}
I20260808 14:40:01.269776 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:40:01.272357 12408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:01.271213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54237 (local address 127.20.81.62:40087)
0808 14:40:01.271255 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:01.271257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:01.271434 (+ 177us) server_negotiation.cc:407] Connection header received
0808 14:40:01.271490 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:01.271490 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:01.271495 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:01.271546 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:01.272148 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:01.272150 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:01.272150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:01.272153 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:01.272167 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:01.272171 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:01.272217 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:01.272286 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:40:01.272299 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:40:01.298549 12398 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:01.298776 12398 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:01.317648 12398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26b85b7482044f9598c012ed52d20e47: Generated new TSK 0
I20260808 14:40:01.317878 12398 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:40:01.321660 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 12313
2026-08-08T14:40:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1416 ms)
[----------] 18 tests from AuthTokenIssuingTest (24846 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:01 dist-test-slave-8n49 krb5kdc[12420](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:01 dist-test-slave-8n49 krb5kdc[12420](info): set up 2 sockets
Aug 08 14:40:01 dist-test-slave-8n49 krb5kdc[12420](info): commencing operation
krb5kdc: starting...
W20260808 14:40:02.412693 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:40:02.535410 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:32855
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:32855,127.20.81.61:42343,127.20.81.60:37543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:02.618362 12435 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:40:02.618647 12435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:02.618681 12435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:02.618724 12435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:02.619860 12435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:02.619938 12435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:02.619966 12435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:02.619987 12435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:02.620015 12435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:02.621567 12435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:32855,127.20.81.61:42343,127.20.81.60:37543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:32855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:02.621882 12435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:02.622143 12435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:40:02.627321 12435 server_base.cc:1034] running on GCE node
W20260808 14:40:02.627296 12440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:02.627292 12441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:02.627290 12443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:02.627794 12435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:02.628142 12435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:02.629329 12435 hybrid_clock.cc:648] HybridClock initialized: now 1786200002629315 us; error 51 us; skew 500 ppm
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:02.632085 12435 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:40:02.632685 12435 webserver.cc:460] Webserver started at http://127.20.81.62:36087/ using document root <none> and password file <none>
I20260808 14:40:02.632928 12435 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:02.632999 12435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:02.633167 12435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:02.634321 12435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "f0fb4c02b195440881575bb57cc2db30"
format_stamp: "Formatted at 2026-08-08 14:40:02 on dist-test-slave-8n49"
server_key: "333d50843be04b4c56ed8aeb7f82738f"
server_key_iv: "d2d005513a15e8a59eb5a470ffe8dd6d"
server_key_version: "encryptionkey@0"
I20260808 14:40:02.634718 12435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "f0fb4c02b195440881575bb57cc2db30"
format_stamp: "Formatted at 2026-08-08 14:40:02 on dist-test-slave-8n49"
server_key: "333d50843be04b4c56ed8aeb7f82738f"
server_key_iv: "d2d005513a15e8a59eb5a470ffe8dd6d"
server_key_version: "encryptionkey@0"
I20260808 14:40:02.636227 12435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:02.637363 12451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:02.637624 12435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:02.637745 12435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "f0fb4c02b195440881575bb57cc2db30"
format_stamp: "Formatted at 2026-08-08 14:40:02 on dist-test-slave-8n49"
server_key: "333d50843be04b4c56ed8aeb7f82738f"
server_key_iv: "d2d005513a15e8a59eb5a470ffe8dd6d"
server_key_version: "encryptionkey@0"
I20260808 14:40:02.637830 12435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:02.647881 12435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:02.650148 12435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:02.650329 12435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:02.654682 12435 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:32855
I20260808 14:40:02.654731 12508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:32855 every 8 connection(s)
I20260808 14:40:02.655148 12435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:02.656167 12509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:02.657872 12509 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:02.660718 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 12435
I20260808 14:40:02.660830 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:40:02.661041 20804 external_mini_cluster.cc:1428] Setting key 19177aae11ca61667cc7a0c155a859a5
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:40:02.668627 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.658697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40518 (local address 127.20.81.62:32855)
0808 14:40:02.658816 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:02.658821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:02.658921 (+ 100us) server_negotiation.cc:407] Connection header received
0808 14:40:02.659500 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:02.659507 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:02.659526 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:02.659627 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:02.660204 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.661317 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.662191 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.662504 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.662647 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.665264 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:02.665278 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:02.665278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:02.665285 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:02.666921 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.667408 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.667410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.667411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.667490 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.667759 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.667760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.667760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.667966 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:02.668029 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:02.668290 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 14:40:02.668389 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":39,"threads_started":1}
I20260808 14:40:02.668661 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.658535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:32855 (local address 127.0.0.1:40518)
0808 14:40:02.658727 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.658808 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:02.659330 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:02.659635 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:02.659638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:02.659932 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:02.660088 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.660093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.661411 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.661413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.662078 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.662080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.662629 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.662630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.662697 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.663272 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:02.663281 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:02.665150 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:02.667017 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.667025 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.667028 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.667313 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.667560 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.667561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.667561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.667684 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.668044 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:02.668052 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:02.668139 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 14:40:02.668252 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 14:40:02.668500 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":69,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for kudu/127.20.81.61@KRBTEST.COM; defaulting to no policy
I20260808 14:40:02.669588 12509 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:02.669996 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.669870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:42343 (local address 127.0.0.1:45086)
0808 14:40:02.669928 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.669975 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 14:40:02.670145 12455 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
I20260808 14:40:02.670629 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.670540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:42343 (local address 127.0.0.1:45100)
0808 14:40:02.670586 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.670612 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:40:02.670761 12509 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.61:42343: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab.
Entry for principal kudu/127.20.81.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab.
I20260808 14:40:02.687791 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.61:42343
--webserver_interface=127.20.81.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab
--principal=kudu/127.20.81.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:32855,127.20.81.61:42343,127.20.81.60:37543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:40:02.719990 12509 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } attempt: 1
I20260808 14:40:02.720588 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.720367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:42343 (local address 127.0.0.1:45108)
0808 14:40:02.720446 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.720503 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 14:40:02.720978 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.720875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:42343 (local address 127.0.0.1:45122)
0808 14:40:02.720922 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.720954 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 14:40:02.721105 12509 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.61:42343: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
W20260808 14:40:02.771807 12517 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:40:02.772010 12517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:02.772027 12517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:02.772080 12517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:02.773293 12517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:02.773337 12517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:02.773351 12517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:02.773365 12517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:02.773377 12517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:02.775336 12517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:32855,127.20.81.61:42343,127.20.81.60:37543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab
--principal=kudu/127.20.81.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.61:42343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.81.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:02.775612 12517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:02.775856 12517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:02.780881 12523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:02.780920 12524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:02.780881 12526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:02.781101 12517 server_base.cc:1034] running on GCE node
I20260808 14:40:02.781378 12517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:02.781725 12517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:02.782899 12517 hybrid_clock.cc:648] HybridClock initialized: now 1786200002782879 us; error 44 us; skew 500 ppm
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:02.785490 12517 init.cc:377] Logged in from keytab as kudu/127.20.81.61@KRBTEST.COM (short username kudu)
I20260808 14:40:02.785943 12517 webserver.cc:460] Webserver started at http://127.20.81.61:37807/ using document root <none> and password file <none>
I20260808 14:40:02.786216 12517 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:02.786293 12517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:02.786453 12517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:02.787573 12517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/data/instance:
uuid: "a7f19403591e494b86561836bbd93c0c"
format_stamp: "Formatted at 2026-08-08 14:40:02 on dist-test-slave-8n49"
server_key: "3212edbad89f78631171b3ee09475788"
server_key_iv: "f059a2da7c264bf3c8c6bb687173825b"
server_key_version: "encryptionkey@0"
I20260808 14:40:02.787962 12517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/wal/instance:
uuid: "a7f19403591e494b86561836bbd93c0c"
format_stamp: "Formatted at 2026-08-08 14:40:02 on dist-test-slave-8n49"
server_key: "3212edbad89f78631171b3ee09475788"
server_key_iv: "f059a2da7c264bf3c8c6bb687173825b"
server_key_version: "encryptionkey@0"
I20260808 14:40:02.789287 12509 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } attempt: 2
I20260808 14:40:02.789525 12517 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:02.789717 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.789590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:42343 (local address 127.0.0.1:45132)
0808 14:40:02.789651 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.789688 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:40:02.790053 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.789955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:42343 (local address 127.0.0.1:45146)
0808 14:40:02.790001 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.790027 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 14:40:02.790148 12509 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.61:42343: Network error: Client connection negotiation failed: client connection to 127.20.81.61:42343: connect: Connection refused (error 111)
I20260808 14:40:02.790458 12535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:02.790649 12517 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:02.790750 12517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/wal
uuid: "a7f19403591e494b86561836bbd93c0c"
format_stamp: "Formatted at 2026-08-08 14:40:02 on dist-test-slave-8n49"
server_key: "3212edbad89f78631171b3ee09475788"
server_key_iv: "f059a2da7c264bf3c8c6bb687173825b"
server_key_version: "encryptionkey@0"
I20260808 14:40:02.790839 12517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:02.814126 12517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:02.816390 12517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:02.816638 12517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:02.820708 12517 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.61:42343
I20260808 14:40:02.820762 12590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.61:42343 every 8 connection(s)
I20260808 14:40:02.821177 12517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
I20260808 14:40:02.822232 12591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:02.823628 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 12517
I20260808 14:40:02.823767 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-1/wal/instance
I20260808 14:40:02.823968 20804 external_mini_cluster.cc:1428] Setting key 1838c790f2b552493b5b99c4236d7da2
I20260808 14:40:02.824004 12591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.81.60@KRBTEST.COM; defaulting to no policy
I20260808 14:40:02.833994 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.824845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40528 (local address 127.20.81.62:32855)
0808 14:40:02.824921 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:02.824923 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:02.825121 (+ 198us) server_negotiation.cc:407] Connection header received
0808 14:40:02.825620 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:02.825621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:02.825639 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:02.825724 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:02.826594 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.827094 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.828124 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.828498 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.828638 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.830894 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:02.830896 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:02.830897 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:02.830907 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:02.832654 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.833056 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.833057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.833058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.833132 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.833383 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.833384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.833384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.833520 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:02.833583 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:02.833823 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 14:40:02.833894 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:40:02.834259 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.824811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:32855 (local address 127.0.0.1:40528)
0808 14:40:02.824984 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.825027 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:02.825477 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:02.825803 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:02.825807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:02.826188 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:02.826485 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.826491 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.827188 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.827189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.828011 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.828013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.828666 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.828667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.828779 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.829366 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:02.829375 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:02.830791 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:02.832746 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.832753 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.832755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.832978 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.833200 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.833201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.833201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.833308 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.833583 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:02.833588 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:02.833707 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 14:40:02.833793 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:40:02.833918 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260808 14:40:02.834875 12591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.60@KRBTEST.COM" created.
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:40:02.843053 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.835178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:42343 (local address 127.0.0.1:45162)
0808 14:40:02.835236 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.835247 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:02.835291 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:02.835543 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:02.835545 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:02.835672 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:02.835721 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.835722 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.836938 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.836939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.837436 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.837438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.838080 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.838081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.838164 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.838567 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:02.838580 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:02.839914 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:02.841936 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.841937 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.841937 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.842107 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.842350 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.842350 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.842351 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.842407 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.842720 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:02.842721 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:02.842760 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:40:02.842823 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 14:40:02.842930 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 14:40:02.843133 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.835244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45162 (local address 127.20.81.61:42343)
0808 14:40:02.835406 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:02.835410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:02.835427 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:40:02.835446 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:02.835448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:02.835460 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:02.835525 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:02.835811 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.836836 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.837525 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.837996 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.838056 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.840007 (+ 1951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:02.840016 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:02.840017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:02.840024 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:02.841842 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.842217 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.842220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.842221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.842282 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.842478 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.842479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.842480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.842647 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:02.842744 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:02.842862 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 14:40:02.843006 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260808 14:40:02.843750 12591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:02.844163 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.844029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36842)
0808 14:40:02.844081 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.844128 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:40:02.844347 12536 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
I20260808 14:40:02.844869 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.844776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36850)
0808 14:40:02.844825 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.844851 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 14:40:02.845005 12591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:37543: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab.
Entry for principal kudu/127.20.81.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab.
I20260808 14:40:02.853586 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.60:37543
--webserver_interface=127.20.81.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab
--principal=kudu/127.20.81.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:40359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:32855,127.20.81.61:42343,127.20.81.60:37543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:40:02.881297 12509 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } attempt: 3
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:40:02.888778 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.881801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45170 (local address 127.20.81.61:42343)
0808 14:40:02.881885 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:02.881887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:02.881899 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:40:02.881930 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:02.881931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:02.881948 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:02.882015 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:02.882380 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.882902 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.883721 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.883988 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.884074 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.886036 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:02.886037 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:02.886038 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:02.886045 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:02.887510 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.887947 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.887949 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.887949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.888010 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.888218 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.888219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.888220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.888337 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:02.888418 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:02.888596 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 14:40:02.888674 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:40:02.888778 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.881709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:42343 (local address 127.0.0.1:45170)
0808 14:40:02.881773 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.881791 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:02.881855 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:02.882023 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:02.882024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:02.882197 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:02.882270 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.882272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.883059 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.883060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.883605 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.883606 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.884073 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.884074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.884166 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.884701 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:02.884711 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:02.885940 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:02.887651 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.887652 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.887653 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.887862 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.888086 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.888087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.888087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.888152 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.888411 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:02.888412 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:02.888461 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 14:40:02.888548 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:40:02.888674 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:40:02.889424 12509 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:02.889803 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.889703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36866)
0808 14:40:02.889751 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.889783 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:40:02.890122 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.890031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36868)
0808 14:40:02.890076 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.890100 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:40:02.890218 12509 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:37543: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
I20260808 14:40:02.894212 12591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } attempt: 1
I20260808 14:40:02.894575 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.894458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36872)
0808 14:40:02.894514 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.894545 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:40:02.894915 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.894807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36884)
0808 14:40:02.894867 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.894891 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:40:02.895001 12591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:37543: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
I20260808 14:40:02.921386 12509 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } attempt: 1
I20260808 14:40:02.921911 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.921761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36900)
0808 14:40:02.921838 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.921879 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 14:40:02.922259 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.922160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36906)
0808 14:40:02.922207 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.922233 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 14:40:02.922411 12509 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:37543: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
W20260808 14:40:02.938932 12599 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:40:02.939132 12599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:02.939150 12599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:02.939169 12599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:02.940306 12599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:02.940346 12599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:02.940361 12599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:02.940374 12599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:02.940387 12599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:02.941987 12599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:40359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:32855,127.20.81.61:42343,127.20.81.60:37543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab
--principal=kudu/127.20.81.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.60:37543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.81.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:02.942190 12599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:02.942366 12599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:02.947472 12604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:02.947516 12607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:02.947516 12605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:02.947865 12599 server_base.cc:1034] running on GCE node
I20260808 14:40:02.948125 12599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:02.948416 12599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:02.949582 12599 hybrid_clock.cc:648] HybridClock initialized: now 1786200002949572 us; error 53 us; skew 500 ppm
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:02.952050 12599 init.cc:377] Logged in from keytab as kudu/127.20.81.60@KRBTEST.COM (short username kudu)
I20260808 14:40:02.952610 12599 webserver.cc:460] Webserver started at http://127.20.81.60:46863/ using document root <none> and password file <none>
I20260808 14:40:02.952875 12599 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:02.952946 12599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:02.953109 12599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:02.954171 12599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/data/instance:
uuid: "1e11a4584f4c4e42afcf3cb6252ef34f"
format_stamp: "Formatted at 2026-08-08 14:40:02 on dist-test-slave-8n49"
server_key: "736c470a99b5a7386146935fcd4f71c0"
server_key_iv: "5fbb0e5542aefdcb084275c59b50d8fe"
server_key_version: "encryptionkey@0"
I20260808 14:40:02.954543 12599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/wal/instance:
uuid: "1e11a4584f4c4e42afcf3cb6252ef34f"
format_stamp: "Formatted at 2026-08-08 14:40:02 on dist-test-slave-8n49"
server_key: "736c470a99b5a7386146935fcd4f71c0"
server_key_iv: "5fbb0e5542aefdcb084275c59b50d8fe"
server_key_version: "encryptionkey@0"
I20260808 14:40:02.955911 12599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:02.956710 12615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:02.956902 12599 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:02.957003 12599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/wal
uuid: "1e11a4584f4c4e42afcf3cb6252ef34f"
format_stamp: "Formatted at 2026-08-08 14:40:02 on dist-test-slave-8n49"
server_key: "736c470a99b5a7386146935fcd4f71c0"
server_key_iv: "5fbb0e5542aefdcb084275c59b50d8fe"
server_key_version: "encryptionkey@0"
I20260808 14:40:02.957096 12599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:02.963156 12591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } attempt: 2
I20260808 14:40:02.963587 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.963447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36912)
0808 14:40:02.963507 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.963545 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:40:02.963960 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.963877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36924)
0808 14:40:02.963919 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.963943 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:40:02.964107 12591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:37543: Network error: Client connection negotiation failed: client connection to 127.20.81.60:37543: connect: Connection refused (error 111)
I20260808 14:40:02.972818 12599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:02.974647 12599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:02.974810 12599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:02.979041 12599 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.60:37543
I20260808 14:40:02.979087 12673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.60:37543 every 8 connection(s)
I20260808 14:40:02.979487 12599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
I20260808 14:40:02.980484 12674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:02.982177 12674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:40:02.989351 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 12599
I20260808 14:40:02.989440 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199735403457-20804-0/minicluster-data/master-2/wal/instance
I20260808 14:40:02.989621 20804 external_mini_cluster.cc:1428] Setting key 59466d20b39f8d124b6cb975e7655bea
I20260808 14:40:02.991518 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.982914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40530 (local address 127.20.81.62:32855)
0808 14:40:02.983000 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:02.983003 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:02.983192 (+ 189us) server_negotiation.cc:407] Connection header received
0808 14:40:02.983698 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:02.983700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:02.983713 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:02.983779 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:02.984403 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.984977 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.985967 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.986179 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.986261 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.988281 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:02.988283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:02.988284 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:02.988291 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:02.989638 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.990251 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.990253 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.990253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.990323 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.990632 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.990633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.990633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.990741 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:02.990796 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:02.991269 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 14:40:02.991406 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:40:02.991580 12676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.982867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:32855 (local address 127.0.0.1:40530)
0808 14:40:02.983072 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.983111 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:02.983588 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:02.983851 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:02.983854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:02.984113 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:02.984302 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.984306 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.985082 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.985083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.985858 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.985861 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.986280 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.986282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.986409 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.986831 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:02.986839 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:02.988180 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:02.989773 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.989782 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.989784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.990099 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.990405 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.990405 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.990406 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.990557 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.990816 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:02.990823 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:02.991000 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 14:40:02.991186 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 14:40:02.991356 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":98,"threads_started":1}
I20260808 14:40:02.992094 12674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:40:02.997625 12509 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } attempt: 2
I20260808 14:40:03.000036 12678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.990028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36934 (local address 127.20.81.60:37543)
0808 14:40:02.990176 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:02.990181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:02.990264 (+ 83us) server_negotiation.cc:407] Connection header received
0808 14:40:02.990297 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:02.990299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:02.990313 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:02.990390 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:02.991163 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.992160 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.993344 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.993859 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.993931 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.996729 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:02.996737 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:02.996738 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:02.996744 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:02.998712 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.999127 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.999130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.999130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.999201 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.999419 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.999420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.999420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.999601 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:02.999774 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:02.999846 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 14:40:02.999925 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260808 14:40:03.000048 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.992447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45172 (local address 127.20.81.61:42343)
0808 14:40:02.992494 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:02.992496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:02.992597 (+ 101us) server_negotiation.cc:407] Connection header received
0808 14:40:02.992678 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:02.992679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:02.992691 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:02.992738 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:02.993064 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.993818 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.994710 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.995061 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.995145 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.997249 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:02.997251 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:02.997251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:02.997259 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:02.998800 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.999155 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.999156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.999157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.999214 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:02.999467 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:02.999468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:02.999468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:02.999627 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:02.999694 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:02.999875 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 14:40:02.999955 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:40:03.000413 12676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.992357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:42343 (local address 127.0.0.1:45172)
0808 14:40:02.992529 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.992540 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:02.992609 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:02.992786 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:02.992787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:02.992928 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:02.992974 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.992975 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.993920 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.993921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.994591 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.994594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.995143 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.995143 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:02.995196 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:02.995566 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:02.995570 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:02.997162 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:02.998890 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.998891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.998891 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.999094 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.999313 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:02.999314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:02.999314 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:02.999374 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:02.999722 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:02.999723 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:02.999763 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:40:03.000215 (+ 452us) client_negotiation.cc:240] Negotiation successful
0808 14:40:03.000306 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":97,"threads_started":1}
I20260808 14:40:03.001083 12674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:02 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
Aug 08 14:40:03 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:40:03.006348 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.998193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36942)
0808 14:40:02.998238 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:02.998249 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:02.998305 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:02.998469 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:02.998470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:02.998653 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:02.998699 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:02.998701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.999573 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:02.999574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:03.000344 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:03.000347 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.000879 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.000880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:03.000943 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.001369 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:03.001375 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:03.002945 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:03.005249 (+ 2304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:03.005250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:03.005250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:03.005484 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:03.005718 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:03.005719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:03.005719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:03.005773 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:03.006035 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:03.006036 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:03.006071 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:40:03.006149 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:40:03.006247 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:40:03.006371 12680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:02.997990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36942 (local address 127.20.81.60:37543)
0808 14:40:02.998163 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:02.998166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:02.998295 (+ 129us) server_negotiation.cc:407] Connection header received
0808 14:40:02.998358 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:02.998359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:02.998370 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:02.998451 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:02.998789 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:02.999441 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.000430 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.000779 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.002025 (+ 1246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.003015 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:03.003016 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:03.003017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:03.003023 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:03.005156 (+ 2133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.005577 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.005578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.005579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.005644 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.005841 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.005842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.005842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.005968 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:03.006041 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:03.006181 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 14:40:03.006259 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
Aug 08 14:40:03 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:40:03.008975 12509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30: Bootstrap starting.
I20260808 14:40:03.009399 12676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:03.001331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36952)
0808 14:40:03.001370 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:03.001382 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:03.001418 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:03.002149 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:03.002150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:03.002252 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:03.002276 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:03.002277 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.002966 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.002967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:03.003690 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:03.003693 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.004182 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.004183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:03.004229 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.004776 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:03.004781 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:03.006303 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:03.008131 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:03.008132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:03.008133 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:03.008352 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:03.008589 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:03.008590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:03.008590 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:03.008678 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:03.009074 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:03.009075 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:03.009116 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:40:03.009202 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:40:03.009292 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 14:40:03.009672 12509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:03.009845 12678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:03.001361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36952 (local address 127.20.81.60:37543)
0808 14:40:03.001405 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.001407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.001420 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:40:03.001469 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.001470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.001479 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.001541 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.002355 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.002868 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.003777 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.004074 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.004139 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.006392 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:03.006393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:03.006393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:03.006400 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:03.008070 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.008439 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.008440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.008441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.008498 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.008767 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.008768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.008769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.008934 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:03.009000 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:03.009672 (+ 672us) server_negotiation.cc:299] Negotiation successful
0808 14:40:03.009759 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:40:03.010037 12509 log.cc:824] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:03.010917 12509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30: No bootstrap required, opened a new log
I20260808 14:40:03.010998 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:03.001242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40542 (local address 127.20.81.62:32855)
0808 14:40:03.001438 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.001440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.001447 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:03.001469 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.001469 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.001479 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.001538 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.002126 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.002839 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.003779 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.003984 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.004073 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.007129 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:03.007130 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:03.007131 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:03.007137 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:03.009390 (+ 2253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.009837 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.009838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.009839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.009900 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.010222 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.010223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.010224 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.010367 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:03.010524 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:03.010826 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 14:40:03.010902 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260808 14:40:03.011629 12674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f: Bootstrap starting.
I20260808 14:40:03.012291 12674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:03.012666 12674 log.cc:824] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:03.013222 12509 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } }
I20260808 14:40:03.013373 12509 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0fb4c02b195440881575bb57cc2db30, State: Initialized, Role: FOLLOWER
I20260808 14:40:03.013464 12509 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } }
I20260808 14:40:03.013502 12674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f: No bootstrap required, opened a new log
I20260808 14:40:03.013819 12509 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:40:03.015806 12695 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:40:03.015909 12695 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:03.015851 12674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } }
I20260808 14:40:03.016005 12674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e11a4584f4c4e42afcf3cb6252ef34f, State: Initialized, Role: FOLLOWER
I20260808 14:40:03.016098 12674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } }
Aug 08 14:40:03 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:40:03.016400 12674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:40:03.018311 12708 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:40:03.018364 12708 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:03.020224 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:03.011635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45174 (local address 127.20.81.61:42343)
0808 14:40:03.011685 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.011687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.011696 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:03.011720 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.011721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.011730 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.011775 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.012241 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.012932 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.013863 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.014088 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.014184 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.016874 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:03.016875 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:03.016875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:03.016883 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:03.018689 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.019121 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.019122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.019122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.019181 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.019378 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.019379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.019379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.019513 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:03.019666 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:03.020049 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 14:40:03.020126 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:40:03.017007 12435 master_runner.cc:186] Error getting master registration for 127.20.81.61:42343: OK, instance_id { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" instance_seqno: 1786200002819514 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:40:03.022068 12435 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:40:03.022608 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:40:03.023576 12479 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f0fb4c02b195440881575bb57cc2db30"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40542
I20260808 14:40:03.023693 12479 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:40:03.023737 12479 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:03.023898 12697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.023977 12697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:03.024705 12479 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } }
I20260808 14:40:03.022385 12599 master_runner.cc:186] Error getting master registration for 127.20.81.61:42343: OK, instance_id { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" instance_seqno: 1786200002819514 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:40:03.024852 12599 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:40:03.024968 12479 leader_election.cc:288] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [CANDIDATE]: Term 1 election: Requested vote from peers a7f19403591e494b86561836bbd93c0c (127.20.81.61:42343), 1e11a4584f4c4e42afcf3cb6252ef34f (127.20.81.60:37543)
I20260808 14:40:03.025375 12647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0fb4c02b195440881575bb57cc2db30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f"
I20260808 14:40:03.025497 12647 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:03.026871 12647 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0fb4c02b195440881575bb57cc2db30 in term 1.
I20260808 14:40:03.027079 12452 leader_election.cc:302] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e11a4584f4c4e42afcf3cb6252ef34f, f0fb4c02b195440881575bb57cc2db30; no voters:
I20260808 14:40:03.027370 12714 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.027462 12714 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:03.027518 12714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:03.027576 12714 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [term 1 LEADER]: Becoming Leader. State: Replica: f0fb4c02b195440881575bb57cc2db30, State: Running, Role: LEADER
I20260808 14:40:03.027671 12714 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } }
I20260808 14:40:03.028113 12714 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0fb4c02b195440881575bb57cc2db30. Latest consensus state: current_term: 1 leader_uuid: "f0fb4c02b195440881575bb57cc2db30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.028204 12714 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:03.033605 12716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:03.033898 12716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:03.043385 12678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:03.032828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36960 (local address 127.20.81.60:37543)
0808 14:40:03.032893 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.032896 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.033567 (+ 671us) server_negotiation.cc:407] Connection header received
0808 14:40:03.033770 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.033771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.033782 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.033816 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.035154 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.035931 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.037425 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.037736 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.037782 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.039494 (+ 1712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:03.039496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:03.039497 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:03.039506 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:03.041508 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.042190 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.042204 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.042205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.042266 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.042601 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.042602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.042603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.042753 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:03.042831 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:03.043194 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 14:40:03.043287 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:40:03.044426 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:03.032914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45180 (local address 127.20.81.61:42343)
0808 14:40:03.032950 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.032952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.034892 (+ 1940us) server_negotiation.cc:407] Connection header received
0808 14:40:03.035017 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.035018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.035030 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.035064 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.035774 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.036481 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.037453 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.037754 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.037792 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.040609 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:03.040610 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:03.040611 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:03.040619 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:03.042548 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.042958 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.042960 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.042960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.043020 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.043243 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.043244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.043244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.043373 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:03.043441 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:03.044240 (+ 799us) server_negotiation.cc:299] Negotiation successful
0808 14:40:03.044327 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:40:03.047720 12647 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [term 1 FOLLOWER]: Refusing update from remote peer f0fb4c02b195440881575bb57cc2db30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:03.048054 12683 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:03.049718 12697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0fb4c02b195440881575bb57cc2db30. Latest consensus state: current_term: 1 leader_uuid: "f0fb4c02b195440881575bb57cc2db30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.049810 12697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:03.050653 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:03.033227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40556 (local address 127.20.81.62:32855)
0808 14:40:03.033276 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.033278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.040700 (+ 7422us) server_negotiation.cc:407] Connection header received
0808 14:40:03.040805 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.040806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.040817 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.040848 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.041503 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.042256 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.045011 (+ 2755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.045327 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.045370 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.047235 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:03.047237 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:03.047237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:03.047247 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:03.048990 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.049392 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.049393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.049393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.049467 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.049837 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.049838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.049838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.049979 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:03.050049 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:03.050440 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 14:40:03.050524 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:40:03.055263 12591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } attempt: 3
Aug 08 14:40:03 dist-test-slave-8n49 krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:40:03.060845 12683 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0fb4c02b195440881575bb57cc2db30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.060959 12683 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:03.061565 12697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0fb4c02b195440881575bb57cc2db30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.061645 12697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:03.062224 12722 mvcc.cc:205] Tried to move back new op lower bound from 7316275212476567552 to 7316275212402130944. Current Snapshot: MvccSnapshot[applied={T|T < 7316275212476567552}]
I20260808 14:40:03.063237 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:03.055510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:37543 (local address 127.0.0.1:36974)
0808 14:40:03.055558 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:03.055568 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:03.055605 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:03.055718 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:03.055719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:03.055885 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:03.055930 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:03.055931 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.056838 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.056840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:03.057327 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:03.057328 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.057867 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.057868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:03.057929 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.058363 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:03.058368 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:03.059771 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:03.062023 (+ 2252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:03.062024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:03.062024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:03.062275 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:03.062550 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:03.062551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:03.062551 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:03.062616 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:03.062907 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:03.062908 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:03.062956 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:40:03.063024 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:40:03.063128 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:40:03.063627 12716 catalog_manager.cc:1347] Generated new cluster ID: d843f852323c4fe2be7d700533ddad5c
I20260808 14:40:03.063678 12716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:03.067523 12678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:03.055556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36974 (local address 127.20.81.60:37543)
0808 14:40:03.055612 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.055615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.055624 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:03.055663 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.055664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.055672 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.055718 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.056007 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.056759 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.057435 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:03.057755 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:03.057814 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:03.059845 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:03.059847 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:03.059847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:03.059868 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:03.061575 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.062410 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.062411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.062412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.062475 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:03.062688 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:03.062689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:03.062689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:03.062817 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:03.062880 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:03.067338 (+ 4458us) server_negotiation.cc:299] Negotiation successful
0808 14:40:03.067424 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:40:03.069058 12591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c: Bootstrap starting.
I20260808 14:40:03.069865 12591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:03.070209 12591 log.cc:824] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:03.071178 12591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c: No bootstrap required, opened a new log
I20260808 14:40:03.074295 12591 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } }
I20260808 14:40:03.074622 12591 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f19403591e494b86561836bbd93c0c, State: Initialized, Role: FOLLOWER
I20260808 14:40:03.074864 12720 mvcc.cc:205] Tried to move back new op lower bound from 7316275212476567552 to 7316275212402130944. Current Snapshot: MvccSnapshot[applied={T|T < 7316275212476567552 or (T in {7316275212476567552})}]
I20260808 14:40:03.074839 12591 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } }
I20260808 14:40:03.075505 12563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0fb4c02b195440881575bb57cc2db30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a7f19403591e494b86561836bbd93c0c"
I20260808 14:40:03.076071 12562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:03.077078 12562 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [term 1 FOLLOWER]: Refusing update from remote peer f0fb4c02b195440881575bb57cc2db30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:03.077361 12683 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:03.078269 12563 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0fb4c02b195440881575bb57cc2db30 in term 1.
I20260808 14:40:03.079814 12591 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:03.083668 12728 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0fb4c02b195440881575bb57cc2db30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.083762 12728 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:03.083809 12728 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0fb4c02b195440881575bb57cc2db30. Latest consensus state: current_term: 1 leader_uuid: "f0fb4c02b195440881575bb57cc2db30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.083860 12728 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:03.083887 12728 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0fb4c02b195440881575bb57cc2db30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.083945 12728 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:40:03.084571 12743 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:40:03.084687 12743 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:03.085500 12716 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:03.085721 12714 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0fb4c02b195440881575bb57cc2db30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb4c02b195440881575bb57cc2db30" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 32855 } } peers { permanent_uuid: "a7f19403591e494b86561836bbd93c0c" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 42343 } } peers { permanent_uuid: "1e11a4584f4c4e42afcf3cb6252ef34f" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 37543 } } }
I20260808 14:40:03.085810 12714 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:03.086220 12716 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:03.086916 12730 mvcc.cc:205] Tried to move back new op lower bound from 7316275212476567552 to 7316275212402130944. Current Snapshot: MvccSnapshot[applied={T|T < 7316275212476567552}]
I20260808 14:40:03.097810 12716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0fb4c02b195440881575bb57cc2db30: Generated new TSK 0
I20260808 14:40:03.098006 12716 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:40:03.129753 12678 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.127762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36990 (local address 127.20.81.60:37543)
0808 14:40:03.127812 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.127815 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.128895 (+ 1080us) server_negotiation.cc:407] Connection header received
0808 14:40:03.129107 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.129108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.129119 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.129163 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.129678 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36990: BlockingRecv error: recv got EOF from 127.0.0.1:36990 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 14:40:03.130524 12512 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.128044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40562 (local address 127.20.81.62:32855)
0808 14:40:03.128088 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.128090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.128987 (+ 897us) server_negotiation.cc:407] Connection header received
0808 14:40:03.130031 (+ 1044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.130032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.130065 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.130096 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.130458 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40562: BlockingRecv error: recv got EOF from 127.0.0.1:40562 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 14:40:03.131196 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.128334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45188 (local address 127.20.81.61:42343)
0808 14:40:03.128377 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.128379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.129973 (+ 1594us) server_negotiation.cc:407] Connection header received
0808 14:40:03.130743 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.130745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.130756 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.130785 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.131118 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45188: BlockingRecv error: recv got EOF from 127.0.0.1:45188 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 14:40:03.133716 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.132915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45204 (local address 127.20.81.61:42343)
0808 14:40:03.132951 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.132953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.133217 (+ 264us) server_negotiation.cc:407] Connection header received
0808 14:40:03.133326 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.133327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.133345 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.133375 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.133669 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45204: BlockingRecv error: recv got EOF from 127.0.0.1:45204 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:40:03.136709 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.135881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45210 (local address 127.20.81.61:42343)
0808 14:40:03.135916 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.135917 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.136183 (+ 266us) server_negotiation.cc:407] Connection header received
0808 14:40:03.136287 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.136288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.136298 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.136328 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.136663 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45210: BlockingRecv error: recv got EOF from 127.0.0.1:45210 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 14:40:03.140760 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.139790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45222 (local address 127.20.81.61:42343)
0808 14:40:03.139825 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.139827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.140078 (+ 251us) server_negotiation.cc:407] Connection header received
0808 14:40:03.140196 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.140197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.140207 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.140254 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.140716 (+ 462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45222: BlockingRecv error: recv got EOF from 127.0.0.1:45222 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 14:40:03.146756 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.145910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45234 (local address 127.20.81.61:42343)
0808 14:40:03.145948 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.145950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.146221 (+ 271us) server_negotiation.cc:407] Connection header received
0808 14:40:03.146325 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.146326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.146337 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.146368 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.146711 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45234: BlockingRecv error: recv got EOF from 127.0.0.1:45234 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 14:40:03.156993 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.155958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45246 (local address 127.20.81.61:42343)
0808 14:40:03.156002 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.156005 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.156306 (+ 301us) server_negotiation.cc:407] Connection header received
0808 14:40:03.156415 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.156416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.156429 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.156461 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.156937 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45246: BlockingRecv error: recv got EOF from 127.0.0.1:45246 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 14:40:03.176717 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.175624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45252 (local address 127.20.81.61:42343)
0808 14:40:03.175678 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.175681 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.176004 (+ 323us) server_negotiation.cc:407] Connection header received
0808 14:40:03.176121 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.176123 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.176149 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.176183 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.176652 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45252: BlockingRecv error: recv got EOF from 127.0.0.1:45252 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 14:40:03.210918 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.210052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45258 (local address 127.20.81.61:42343)
0808 14:40:03.210103 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.210106 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.210278 (+ 172us) server_negotiation.cc:407] Connection header received
0808 14:40:03.210362 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.210363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.210377 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.210450 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.210853 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45258: BlockingRecv error: recv got EOF from 127.0.0.1:45258 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 14:40:03.276933 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.276161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45266 (local address 127.20.81.61:42343)
0808 14:40:03.276268 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.276270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.276333 (+ 63us) server_negotiation.cc:407] Connection header received
0808 14:40:03.276369 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.276370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.276382 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.276457 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.276829 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45266: BlockingRecv error: recv got EOF from 127.0.0.1:45266 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 14:40:03.406986 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.406270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45280 (local address 127.20.81.61:42343)
0808 14:40:03.406343 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.406345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.406372 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:40:03.406462 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.406463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.406475 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.406535 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.406911 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45280: BlockingRecv error: recv got EOF from 127.0.0.1:45280 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 14:40:03.664916 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:03.664260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45294 (local address 127.20.81.61:42343)
0808 14:40:03.664329 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:03.664331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:03.664340 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:03.664369 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:03.664370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:03.664380 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:03.664442 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:03.664829 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45294: BlockingRecv error: recv got EOF from 127.0.0.1:45294 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:40:04.018807 12708 catalog_manager.cc:1259] Loaded cluster ID: d843f852323c4fe2be7d700533ddad5c
I20260808 14:40:04.018889 12708 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f: loading cluster ID for follower catalog manager: success
I20260808 14:40:04.019757 12708 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f: acquiring CA information for follower catalog manager: success
I20260808 14:40:04.020090 12708 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e11a4584f4c4e42afcf3cb6252ef34f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:40:04.085227 12743 catalog_manager.cc:1259] Loaded cluster ID: d843f852323c4fe2be7d700533ddad5c
I20260808 14:40:04.085314 12743 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c: loading cluster ID for follower catalog manager: success
I20260808 14:40:04.086185 12743 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c: acquiring CA information for follower catalog manager: success
I20260808 14:40:04.086532 12743 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a7f19403591e494b86561836bbd93c0c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:40:04.181264 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:04.178279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45308 (local address 127.20.81.61:42343)
0808 14:40:04.178411 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:04.178413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:04.178463 (+ 50us) server_negotiation.cc:407] Connection header received
0808 14:40:04.178569 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:04.178570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:04.178638 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:04.178727 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:04.178896 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.179406 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.180256 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.180526 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.180690 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:04.180887 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:04.181004 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:04.181093 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:04.181139 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 14:40:04.181162 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":59,"threads_started":1}
I20260808 14:40:04.185223 12825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:04.183026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37000 (local address 127.20.81.60:37543)
0808 14:40:04.183150 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:04.183152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:04.183160 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:04.183207 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:04.183208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:04.183269 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:04.183340 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:04.183424 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.183880 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.184539 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.184743 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.184794 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:04.184910 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:04.185001 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:04.185051 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:04.185085 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 14:40:04.185101 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":79,"threads_started":1}
I20260808 14:40:04.189749 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:04.186733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45314 (local address 127.20.81.61:42343)
0808 14:40:04.186778 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:04.186780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:04.186915 (+ 135us) server_negotiation.cc:407] Connection header received
0808 14:40:04.186988 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:04.186989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:04.187001 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:04.187072 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:04.187203 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.187862 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.188863 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.189153 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.189239 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:04.189406 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:04.189437 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:04.189484 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:04.189636 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 14:40:04.189666 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:40:04.189988 12825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:04.186780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37016 (local address 127.20.81.60:37543)
0808 14:40:04.186841 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:04.186843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:04.187124 (+ 281us) server_negotiation.cc:407] Connection header received
0808 14:40:04.187149 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:04.187150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:04.187160 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:04.187209 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:04.187374 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.188084 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.189077 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.189370 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.189429 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:04.189558 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:04.189589 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:04.189635 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:04.189905 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 14:40:04.189928 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:40:04.190435 12833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:04.186971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40564 (local address 127.20.81.62:32855)
0808 14:40:04.187253 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:04.187255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:04.187375 (+ 120us) server_negotiation.cc:407] Connection header received
0808 14:40:04.187427 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:04.187428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:04.187476 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:04.187575 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:04.187701 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.188370 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.189358 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:04.189678 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:04.189740 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:04.189935 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:04.190051 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:04.190107 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:04.190307 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 14:40:04.190331 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":68,"threads_started":1}
I20260808 14:40:04.192216 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 12435
I20260808 14:40:04.202134 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 12517
I20260808 14:40:04.208621 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 12599
2026-08-08T14:40:04Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2887 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:04 dist-test-slave-8n49 krb5kdc[12837](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:04 dist-test-slave-8n49 krb5kdc[12837](info): set up 2 sockets
Aug 08 14:40:04 dist-test-slave-8n49 krb5kdc[12837](info): commencing operation
krb5kdc: starting...
W20260808 14:40:05.285377 20804 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/test-user.keytab.
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.81.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
Entry for principal kudu/127.20.81.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab.
I20260808 14:40:05.411252 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:39075
--webserver_interface=127.20.81.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:45901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:39075,127.20.81.61:40355,127.20.81.60:42593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:05.492645 12851 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:40:05.492898 12851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:05.492929 12851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:05.492973 12851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:05.494096 12851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:05.494171 12851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:05.494197 12851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:05.494230 12851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:05.494261 12851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:05.495738 12851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:45901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:39075,127.20.81.61:40355,127.20.81.60:42593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.62.keytab
--principal=kudu/127.20.81.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.62:39075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.81.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:05.496017 12851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:05.496245 12851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:05.501214 12859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:05.501220 12858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:05.501287 12851 server_base.cc:1034] running on GCE node
W20260808 14:40:05.501227 12861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:05.501725 12851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:05.501961 12851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:05.503099 12851 hybrid_clock.cc:648] HybridClock initialized: now 1786200005503086 us; error 30 us; skew 500 ppm
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:05.505586 12851 init.cc:377] Logged in from keytab as kudu/127.20.81.62@KRBTEST.COM (short username kudu)
I20260808 14:40:05.506031 12851 webserver.cc:460] Webserver started at http://127.20.81.62:40063/ using document root <none> and password file <none>
I20260808 14:40:05.506235 12851 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:05.506276 12851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:05.506363 12851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:05.507356 12851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/data/instance:
uuid: "a4442f028e94491e9ae9c9fc212dfe4e"
format_stamp: "Formatted at 2026-08-08 14:40:05 on dist-test-slave-8n49"
server_key: "b1041544f9e7e29add2ca440d16a657e"
server_key_iv: "0730d057d56a3dc6baeaf6a01776f8bb"
server_key_version: "encryptionkey@0"
I20260808 14:40:05.507673 12851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/wal/instance:
uuid: "a4442f028e94491e9ae9c9fc212dfe4e"
format_stamp: "Formatted at 2026-08-08 14:40:05 on dist-test-slave-8n49"
server_key: "b1041544f9e7e29add2ca440d16a657e"
server_key_iv: "0730d057d56a3dc6baeaf6a01776f8bb"
server_key_version: "encryptionkey@0"
I20260808 14:40:05.508961 12851 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:05.509634 12868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:05.509821 12851 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:05.509912 12851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/wal
uuid: "a4442f028e94491e9ae9c9fc212dfe4e"
format_stamp: "Formatted at 2026-08-08 14:40:05 on dist-test-slave-8n49"
server_key: "b1041544f9e7e29add2ca440d16a657e"
server_key_iv: "0730d057d56a3dc6baeaf6a01776f8bb"
server_key_version: "encryptionkey@0"
I20260808 14:40:05.509994 12851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:05.521152 12851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:05.522862 12851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:05.523023 12851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:05.527362 12851 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.62:39075
I20260808 14:40:05.527397 12925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.62:39075 every 8 connection(s)
I20260808 14:40:05.527750 12851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:05.528780 12926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:05.530342 12926 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:40:05.536796 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 12851
I20260808 14:40:05.536877 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-0/wal/instance
I20260808 14:40:05.537087 20804 external_mini_cluster.cc:1428] Setting key 9b2e3f6ed3cdc8b0f7068e6afb404f54
I20260808 14:40:05.539705 12930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.531011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55186 (local address 127.20.81.62:39075)
0808 14:40:05.531174 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.531186 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.531251 (+ 65us) server_negotiation.cc:407] Connection header received
0808 14:40:05.531756 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.531758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.531775 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.531855 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.532372 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.533258 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.534082 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.534384 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.534462 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.536391 (+ 1929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.536399 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.536399 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.536405 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.538071 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.538490 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.538493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.538493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.538581 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.538822 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.538823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.538823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.539033 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.539138 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.539321 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.539460 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260808 14:40:05.539707 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.530941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:39075 (local address 127.0.0.1:55186)
0808 14:40:05.531128 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.531171 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:05.531623 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:05.531890 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:05.531892 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:05.532139 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:05.532289 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.532292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.533340 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.533341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.534006 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.534007 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.534474 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.534475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.534528 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.534988 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:05.534996 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:05.536311 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:05.538189 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.538196 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.538198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.538390 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.538662 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.538662 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.538663 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.538753 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.539111 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:05.539116 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:05.539178 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 14:40:05.539287 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 14:40:05.539524 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":99,"thread_start_us":98,"threads_started":1}
I20260808 14:40:05.540398 12926 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:05.540783 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.540660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:40355 (local address 127.0.0.1:43664)
0808 14:40:05.540708 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.540752 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 14:40:05.540908 12870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
I20260808 14:40:05.541308 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.541214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:40355 (local address 127.0.0.1:43666)
0808 14:40:05.541263 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.541287 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 14:40:05.541411 12926 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.61:40355: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.20.81.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab.
Entry for principal kudu/127.20.81.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab.
I20260808 14:40:05.563323 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.61:40355
--webserver_interface=127.20.81.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab
--principal=kudu/127.20.81.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:45901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:39075,127.20.81.61:40355,127.20.81.60:42593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:40:05.590615 12926 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } attempt: 1
I20260808 14:40:05.591092 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.590958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:40355 (local address 127.0.0.1:43668)
0808 14:40:05.591022 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.591062 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:40:05.591471 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.591373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:40355 (local address 127.0.0.1:43672)
0808 14:40:05.591421 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.591447 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:40:05.591562 12926 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.61:40355: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
W20260808 14:40:05.645139 12934 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:40:05.645414 12934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:05.645444 12934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:05.645485 12934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:05.646637 12934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:05.646718 12934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:05.646744 12934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:05.646764 12934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:05.646791 12934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:05.648306 12934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:45901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:39075,127.20.81.61:40355,127.20.81.60:42593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.61.keytab
--principal=kudu/127.20.81.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.61:40355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.81.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:05.648633 12934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:05.648876 12934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:05.653690 12941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:05.653751 12943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:05.653898 12940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:05.654192 12934 server_base.cc:1034] running on GCE node
I20260808 14:40:05.654410 12934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:05.654676 12934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:05.655838 12934 hybrid_clock.cc:648] HybridClock initialized: now 1786200005655819 us; error 29 us; skew 500 ppm
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:05.658372 12934 init.cc:377] Logged in from keytab as kudu/127.20.81.61@KRBTEST.COM (short username kudu)
I20260808 14:40:05.658831 12934 webserver.cc:460] Webserver started at http://127.20.81.61:39109/ using document root <none> and password file <none>
I20260808 14:40:05.659070 12934 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:05.659116 12934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:05.659279 12934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:05.659713 12926 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } attempt: 2
I20260808 14:40:05.660104 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.659973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:40355 (local address 127.0.0.1:43686)
0808 14:40:05.660039 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.660074 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 14:40:05.660482 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.660392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:40355 (local address 127.0.0.1:43690)
0808 14:40:05.660439 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.660464 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 14:40:05.660636 12926 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.61:40355: Network error: Client connection negotiation failed: client connection to 127.20.81.61:40355: connect: Connection refused (error 111)
I20260808 14:40:05.660634 12934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/data/instance:
uuid: "78178fce03ce4c7285f6ca0a006354d2"
format_stamp: "Formatted at 2026-08-08 14:40:05 on dist-test-slave-8n49"
server_key: "f626b38614eccb5a0ab2da6054385ed2"
server_key_iv: "50c3a20faf946dba3c3469062f1a84c8"
server_key_version: "encryptionkey@0"
I20260808 14:40:05.661075 12934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/wal/instance:
uuid: "78178fce03ce4c7285f6ca0a006354d2"
format_stamp: "Formatted at 2026-08-08 14:40:05 on dist-test-slave-8n49"
server_key: "f626b38614eccb5a0ab2da6054385ed2"
server_key_iv: "50c3a20faf946dba3c3469062f1a84c8"
server_key_version: "encryptionkey@0"
I20260808 14:40:05.662452 12934 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:40:05.663203 12951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:05.663388 12934 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:05.663512 12934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/wal
uuid: "78178fce03ce4c7285f6ca0a006354d2"
format_stamp: "Formatted at 2026-08-08 14:40:05 on dist-test-slave-8n49"
server_key: "f626b38614eccb5a0ab2da6054385ed2"
server_key_iv: "50c3a20faf946dba3c3469062f1a84c8"
server_key_version: "encryptionkey@0"
I20260808 14:40:05.663600 12934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:05.679733 12934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:05.681651 12934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:05.681826 12934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:05.685813 12934 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.61:40355
I20260808 14:40:05.685870 13006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.61:40355 every 8 connection(s)
I20260808 14:40:05.686236 12934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/data/info.pb
I20260808 14:40:05.687175 13007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:05.688271 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 12934
I20260808 14:40:05.688385 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-1/wal/instance
I20260808 14:40:05.688656 20804 external_mini_cluster.cc:1428] Setting key dc0c99ac3ec6e1702098f04a7e1274f8
I20260808 14:40:05.689226 13007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.81.60@KRBTEST.COM; defaulting to no policy
I20260808 14:40:05.699508 12930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.690117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55188 (local address 127.20.81.62:39075)
0808 14:40:05.690188 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.690190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.690372 (+ 182us) server_negotiation.cc:407] Connection header received
0808 14:40:05.690887 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.690888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.690906 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.690976 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.691681 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.692165 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.693805 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.694001 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.694060 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.696578 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.696580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.696580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.696588 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.698044 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.698488 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.698490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.698491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.698558 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.698827 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.698828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.698829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.698951 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.699025 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.699321 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.699409 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:40:05.699783 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.690059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:39075 (local address 127.0.0.1:55188)
0808 14:40:05.690227 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.690270 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:05.690775 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:05.691046 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:05.691051 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:05.691302 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:05.691585 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.691592 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.692273 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.692274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.693718 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.693722 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.694108 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.694110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.694284 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.694838 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:05.694850 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:05.696455 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:05.698151 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.698160 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.698162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.698390 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.698629 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.698630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.698630 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.698749 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.699030 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:05.699038 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:05.699184 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 14:40:05.699299 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:40:05.699458 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.81.60@KRBTEST.COM" created.
I20260808 14:40:05.700471 13007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:40:05.708506 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.700866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43702 (local address 127.20.81.61:40355)
0808 14:40:05.701025 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.701031 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.701078 (+ 47us) server_negotiation.cc:407] Connection header received
0808 14:40:05.701145 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.701148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.701161 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.701226 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.701493 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.702409 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.703094 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.703473 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.703562 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.705686 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.705694 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.705695 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.705701 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.707286 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.707705 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.707708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.707708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.707760 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.707972 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.707973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.707973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.708109 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.708181 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.708359 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.708427 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":99,"threads_started":1}
I20260808 14:40:05.708679 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.700791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:40355 (local address 127.0.0.1:43702)
0808 14:40:05.701016 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.701028 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:05.701081 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:05.701224 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:05.701225 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:05.701366 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:05.701409 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.701411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.702514 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.702515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.703000 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.703010 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.703559 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.703560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.703633 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.704067 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:05.704072 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:05.705597 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:05.707381 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.707382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.707383 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.707616 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.707833 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.707834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.707835 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.707909 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.708194 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:05.708195 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:05.708249 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 14:40:05.708337 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:40:05.708501 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":51}
I20260808 14:40:05.709829 13007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:05.710210 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.710111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48164)
0808 14:40:05.710148 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.710192 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 14:40:05.710356 12953 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
I20260808 14:40:05.710814 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.710729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48170)
0808 14:40:05.710774 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.710798 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 14:40:05.710918 13007 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:42593: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.81.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab.
Entry for principal kudu/127.20.81.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab.
I20260808 14:40:05.717793 20804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx904RQ/build/release/bin/kudu
/tmp/dist-test-taskx904RQ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.60:42593
--webserver_interface=127.20.81.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab
--principal=kudu/127.20.81.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.81.20:45901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.81.62:39075,127.20.81.61:40355,127.20.81.60:42593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:40:05.751811 12926 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } attempt: 3
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:40:05.758929 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.752291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43716 (local address 127.20.81.61:40355)
0808 14:40:05.752369 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.752372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.752382 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:40:05.752476 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.752477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.752488 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.752554 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.752915 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.753423 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.754142 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.754364 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.754463 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.756343 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.756345 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.756345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.756353 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.757763 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.758116 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.758117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.758117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.758174 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.758384 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.758385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.758386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.758506 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.758586 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.758742 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.758824 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:40:05.758956 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.752219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:40355 (local address 127.0.0.1:43716)
0808 14:40:05.752278 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.752297 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:05.752369 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:05.752596 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:05.752598 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:05.752762 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:05.752829 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.752830 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.753513 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.753515 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.754051 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.754053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.754463 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.754464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.754545 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.755035 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:05.755040 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:05.756248 (+ 1208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:05.757857 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.757858 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.757859 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.758040 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.758247 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.758248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.758248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.758312 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.758578 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:05.758579 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:05.758627 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:40:05.758718 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:40:05.758824 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:40:05.759378 12926 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:05.759732 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.759619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48176)
0808 14:40:05.759673 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.759700 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 14:40:05.760027 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.759935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48182)
0808 14:40:05.759983 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.760006 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 14:40:05.760131 13007 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } attempt: 1
W20260808 14:40:05.760334 12926 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:42593: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
I20260808 14:40:05.760450 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.760353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48192)
0808 14:40:05.760389 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.760418 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 14:40:05.760792 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.760737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48196)
0808 14:40:05.760760 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.760780 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260808 14:40:05.760897 13007 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:42593: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
I20260808 14:40:05.791543 12926 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } attempt: 1
I20260808 14:40:05.792062 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.791923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48202)
0808 14:40:05.791992 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.792030 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 14:40:05.792500 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.792345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48212)
0808 14:40:05.792423 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.792468 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 14:40:05.792723 12926 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:42593: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
W20260808 14:40:05.801757 13014 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:40:05.801954 13014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:05.801971 13014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:05.802042 13014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:05.803171 13014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:05.803211 13014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:05.803225 13014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:05.803278 13014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:05.803299 13014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:05.804888 13014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.81.20:45901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.81.62:39075,127.20.81.61:40355,127.20.81.60:42593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/krb5kdc/kudu_127.20.81.60.keytab
--principal=kudu/127.20.81.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.81.60:42593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.81.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:05.805156 13014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:05.805395 13014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:05.810320 13022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:05.810299 13020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:05.810336 13014 server_base.cc:1034] running on GCE node
W20260808 14:40:05.810298 13019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:05.810786 13014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:05.811079 13014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:05.812264 13014 hybrid_clock.cc:648] HybridClock initialized: now 1786200005812246 us; error 36 us; skew 500 ppm
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:05.814822 13014 init.cc:377] Logged in from keytab as kudu/127.20.81.60@KRBTEST.COM (short username kudu)
I20260808 14:40:05.815301 13014 webserver.cc:460] Webserver started at http://127.20.81.60:46009/ using document root <none> and password file <none>
I20260808 14:40:05.815552 13014 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:05.815632 13014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:05.815783 13014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:05.816933 13014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/data/instance:
uuid: "253df1be278c4208b8ab7ba1cab0503e"
format_stamp: "Formatted at 2026-08-08 14:40:05 on dist-test-slave-8n49"
server_key: "31e8d6a17ccd82cbacab7200b3940a8e"
server_key_iv: "0a850838f16f00b67865b3534fa3ad06"
server_key_version: "encryptionkey@0"
I20260808 14:40:05.817301 13014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/wal/instance:
uuid: "253df1be278c4208b8ab7ba1cab0503e"
format_stamp: "Formatted at 2026-08-08 14:40:05 on dist-test-slave-8n49"
server_key: "31e8d6a17ccd82cbacab7200b3940a8e"
server_key_iv: "0a850838f16f00b67865b3534fa3ad06"
server_key_version: "encryptionkey@0"
I20260808 14:40:05.818631 13014 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:40:05.819360 13029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:05.819527 13014 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:05.819638 13014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/data,/tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/wal
uuid: "253df1be278c4208b8ab7ba1cab0503e"
format_stamp: "Formatted at 2026-08-08 14:40:05 on dist-test-slave-8n49"
server_key: "31e8d6a17ccd82cbacab7200b3940a8e"
server_key_iv: "0a850838f16f00b67865b3534fa3ad06"
server_key_version: "encryptionkey@0"
I20260808 14:40:05.819715 13014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:05.829032 13007 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } attempt: 2
I20260808 14:40:05.829458 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.829304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48214)
0808 14:40:05.829382 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.829422 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:40:05.829696 13014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:05.829838 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.829727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48228)
0808 14:40:05.829783 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.829814 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 14:40:05.829945 13007 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.81.60:42593: Network error: Client connection negotiation failed: client connection to 127.20.81.60:42593: connect: Connection refused (error 111)
I20260808 14:40:05.831915 13014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:05.832077 13014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:05.836007 13014 rpc_server.cc:307] RPC server started. Bound to: 127.20.81.60:42593
I20260808 14:40:05.836036 13088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.81.60:42593 every 8 connection(s)
I20260808 14:40:05.836383 13014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/data/info.pb
I20260808 14:40:05.837423 13089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:05.838946 13089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:05.842908 20804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx904RQ/build/release/bin/kudu as pid 13014
I20260808 14:40:05.843045 20804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx904RQ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199735403457-20804-0/minicluster-data/master-2/wal/instance
I20260808 14:40:05.843288 20804 external_mini_cluster.cc:1428] Setting key 1bc2fc8b56e7a8e18681582a99be20a4
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:40:05.848170 12930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.839641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55194 (local address 127.20.81.62:39075)
0808 14:40:05.839708 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.839710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.839890 (+ 180us) server_negotiation.cc:407] Connection header received
0808 14:40:05.840397 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.840399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.840412 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.840463 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.841118 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.841590 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.842559 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.842771 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.842850 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.845328 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.845329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.845330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.845337 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.846746 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.847202 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.847204 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.847204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.847263 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.847515 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.847516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.847517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.847641 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.847715 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.847995 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.848079 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:40:05.848369 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.839613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.62:39075 (local address 127.0.0.1:55194)
0808 14:40:05.839776 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.839811 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:05.840283 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:05.840532 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:05.840536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:05.840816 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:05.841011 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.841015 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.841689 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.841690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.842465 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.842467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.842872 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.842873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.842996 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.843624 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:05.843635 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:05.845222 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:05.846873 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.846881 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.846884 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.847107 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.847330 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.847331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.847331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.847444 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.847718 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:05.847726 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:05.847863 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 14:40:05.847973 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:40:05.848126 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:40:05.848979 13089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:05.851814 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.843719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48236 (local address 127.20.81.60:42593)
0808 14:40:05.843872 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.843876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.843903 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:40:05.843956 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.843959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.843979 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.844059 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.844700 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.845434 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.846194 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.846502 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.846586 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.848994 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.849003 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.849004 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.849011 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.850577 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.850962 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.850965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.850965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.851023 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.851242 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.851243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.851243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.851383 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.851537 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.851628 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.851706 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":91,"threads_started":1}
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:40:05.856184 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.849362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43728 (local address 127.20.81.61:40355)
0808 14:40:05.849427 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.849430 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.849438 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:05.849465 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.849466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.849477 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.849640 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.849906 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.850484 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.851147 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.851361 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.851437 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.853507 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.853508 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.853509 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.853515 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.855023 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.855400 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.855401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.855401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.855467 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.855712 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.855713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.855713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.855817 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.855871 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.856057 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.856116 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:40:05.856261 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.849274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.61:40355 (local address 127.0.0.1:43728)
0808 14:40:05.849306 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.849316 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:05.849353 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:05.849647 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:05.849648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:05.849786 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:05.849829 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.849830 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.850578 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.850579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.851047 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.851048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.851435 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.851436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.851507 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.851913 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:05.851917 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:05.853435 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:05.855101 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.855102 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.855102 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.855325 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.855539 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.855540 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.855540 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.855638 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.855893 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:05.855895 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:05.855942 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:40:05.856031 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:40:05.856131 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 14:40:05.856715 13089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.62@KRBTEST.COM
I20260808 14:40:05.860438 12930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.852654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55210 (local address 127.20.81.62:39075)
0808 14:40:05.852695 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.852697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.852749 (+ 52us) server_negotiation.cc:407] Connection header received
0808 14:40:05.852824 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.852825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.852832 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.852874 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.853436 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.853873 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.854678 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.854991 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.855072 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.857756 (+ 2684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.857757 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.857757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.857763 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.859261 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.859654 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.859655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.859655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.859713 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.859923 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.859924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.859924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.860039 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.860229 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.860267 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.860341 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.60@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:40:05.863782 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.856965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48242)
0808 14:40:05.857013 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.857023 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:05.857059 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:05.857181 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:05.857182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:05.857332 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:05.857364 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.857368 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.858213 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.858214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.858987 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.858989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.859454 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.859455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.859494 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.859884 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:05.859889 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:05.861262 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:05.862833 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.862834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.862834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.862987 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.863189 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.863190 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.863190 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.863238 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.863491 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:05.863492 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:05.863533 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:40:05.863624 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:40:05.863728 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:40:05.863893 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.857037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48242 (local address 127.20.81.60:42593)
0808 14:40:05.857072 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.857074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.857081 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:05.857104 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.857105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.857114 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.857179 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.857453 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.858130 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.859107 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.859370 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.859443 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.861341 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.861342 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.861342 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.861348 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.862753 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.863056 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.863056 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.863057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.863116 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.863303 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.863304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.863304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.863424 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.863474 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.863653 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.863788 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":18}
I20260808 14:40:05.865303 13089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e: Bootstrap starting.
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.81.61@KRBTEST.COM
I20260808 14:40:05.866386 13089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:05.866688 13089 log.cc:824] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:05.867491 13089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e: No bootstrap required, opened a new log
I20260808 14:40:05.867906 12926 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } attempt: 2
I20260808 14:40:05.869000 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.861155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43742 (local address 127.20.81.61:40355)
0808 14:40:05.861190 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.861192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.861201 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:05.861227 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.861228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.861236 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.861286 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.861882 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.862443 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.863338 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.863597 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.863659 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.866067 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.866068 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.866068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.866075 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.867664 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.868043 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.868045 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.868045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.868103 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.868421 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.868422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.868422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.868622 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.868801 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.868841 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.868913 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:40:05.870072 13089 raft_consensus.cc:348] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } }
I20260808 14:40:05.870223 13089 raft_consensus.cc:729] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253df1be278c4208b8ab7ba1cab0503e, State: Initialized, Role: FOLLOWER
I20260808 14:40:05.870296 13089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } }
I20260808 14:40:05.870407 20804 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:40:05.870599 13089 sys_catalog.cc:564] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.62@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:40:05.871484 12896 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a4442f028e94491e9ae9c9fc212dfe4e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55210
I20260808 14:40:05.872110 13096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
W20260808 14:40:05.872589 13107 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 14:40:05.872730 13096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:40:05.872941 13107 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:05.875795 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.868129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48252)
0808 14:40:05.868174 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.868185 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:05.868224 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:05.868371 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:05.868373 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:05.868528 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:05.868636 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.868639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.869534 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.869535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.870387 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.870390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.870812 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.870813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.870871 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.871289 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:05.871295 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:05.872842 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:05.874605 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.874607 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.874607 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.874868 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.875093 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.875094 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.875095 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.875157 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.875481 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:05.875482 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:05.875530 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:40:05.875607 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:40:05.875703 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 14:40:05.875816 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.868217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48252 (local address 127.20.81.60:42593)
0808 14:40:05.868250 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.868251 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.868258 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:05.868276 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.868277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.868285 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.868351 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.868719 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.869401 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.870465 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.870714 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.870779 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.872940 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.872941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.872941 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.872947 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.874491 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.874956 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.874957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.874957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.875020 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.875225 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.875226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.875226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.875380 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.875449 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.875653 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.875730 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:40:05.873405 13014 master_runner.cc:186] Error getting master registration for 127.20.81.62:39075: OK, instance_id { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" instance_seqno: 1786200005526178 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:40:05.876471 13014 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:40:05.877357 12926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e: Bootstrap starting.
I20260808 14:40:05.878077 12926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:05.878432 12926 log.cc:824] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:05.879297 12926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e: No bootstrap required, opened a new log
I20260808 14:40:05.880702 12926 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } }
I20260808 14:40:05.880852 12926 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4442f028e94491e9ae9c9fc212dfe4e, State: Initialized, Role: FOLLOWER
I20260808 14:40:05.880937 12926 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } }
I20260808 14:40:05.881206 13110 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
I20260808 14:40:05.881269 12926 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:05.881291 12896 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:40:05.881379 12896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:05.882126 12896 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } }
I20260808 14:40:05.882398 12896 leader_election.cc:288] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [CANDIDATE]: Term 1 election: Requested vote from peers 78178fce03ce4c7285f6ca0a006354d2 (127.20.81.61:40355), 253df1be278c4208b8ab7ba1cab0503e (127.20.81.60:42593)
W20260808 14:40:05.883174 13121 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:40:05.883232 13121 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:05.881294 13110 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:05.883538 13058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "253df1be278c4208b8ab7ba1cab0503e"
I20260808 14:40:05.883663 13058 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:05.884943 13058 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4442f028e94491e9ae9c9fc212dfe4e in term 1.
I20260808 14:40:05.885169 12870 leader_election.cc:302] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 253df1be278c4208b8ab7ba1cab0503e, a4442f028e94491e9ae9c9fc212dfe4e; no voters:
I20260808 14:40:05.885345 13110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:05.885630 13110 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [term 1 LEADER]: Becoming Leader. State: Replica: a4442f028e94491e9ae9c9fc212dfe4e, State: Running, Role: LEADER
I20260808 14:40:05.885833 13110 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } }
I20260808 14:40:05.886556 13110 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4442f028e94491e9ae9c9fc212dfe4e. Latest consensus state: current_term: 1 leader_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
I20260808 14:40:05.886766 13110 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:05.883936 12851 master_runner.cc:186] Error getting master registration for 127.20.81.61:40355: OK, instance_id { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" instance_seqno: 1786200005684599 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:40:05.886922 12851 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:40:05.887161 13130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:05.887351 13130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:05.888769 13058 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [term 1 FOLLOWER]: Refusing update from remote peer a4442f028e94491e9ae9c9fc212dfe4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:05.889074 13110 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:05.890280 13096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4442f028e94491e9ae9c9fc212dfe4e. Latest consensus state: current_term: 1 leader_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
I20260808 14:40:05.890368 13096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:05.901089 13110 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
I20260808 14:40:05.901191 13110 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:05.901259 13131 mvcc.cc:205] Tried to move back new op lower bound from 7316275224118050816 to 7316275224109907968. Current Snapshot: MvccSnapshot[applied={T|T < 7316275224118050816}]
I20260808 14:40:05.901851 13130 catalog_manager.cc:1347] Generated new cluster ID: a303e03e04ef49578c1dd7fd25fcaba5
I20260808 14:40:05.901906 13130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:05.901870 13096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
I20260808 14:40:05.901947 13096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:05.902915 13132 mvcc.cc:205] Tried to move back new op lower bound from 7316275224118050816 to 7316275224109907968. Current Snapshot: MvccSnapshot[applied={T|T < 7316275224118050816}]
I20260808 14:40:05.904466 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.890345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48254 (local address 127.20.81.60:42593)
0808 14:40:05.890381 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.890383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.896692 (+ 6309us) server_negotiation.cc:407] Connection header received
0808 14:40:05.896790 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.896791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.896801 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.896830 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.897556 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.898269 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.899263 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.899554 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.899593 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.901656 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.901658 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.901658 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.901665 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.903304 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.903707 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.903708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.903709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.903762 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.903952 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.903953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.903953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.904064 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.904136 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.904311 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.904379 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:05.904721 12930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.889657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55214 (local address 127.20.81.62:39075)
0808 14:40:05.889703 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.889705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.892913 (+ 3208us) server_negotiation.cc:407] Connection header received
0808 14:40:05.893733 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.893734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.893744 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.893773 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.894436 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.895131 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.897074 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.897355 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.897415 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.899881 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.899882 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.899883 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.899890 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.902811 (+ 2921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.903849 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.903850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.903851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.903909 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.904107 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.904107 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.904108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.904246 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.904327 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.904535 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.904632 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:05.909694 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.889361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43756 (local address 127.20.81.61:40355)
0808 14:40:05.889419 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.889421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.892735 (+ 3314us) server_negotiation.cc:407] Connection header received
0808 14:40:05.892848 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.892849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.892860 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.892914 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.893663 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.894450 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.896140 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.896435 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.896494 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.898964 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.898965 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.898966 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.898990 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.900924 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.908661 (+ 7737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.908662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.908663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.908738 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.909031 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.909033 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.909033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.909166 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.909228 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.909523 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.909598 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:40:05.917058 13130 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:05.917770 13130 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:05.921058 13007 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } attempt: 3
Aug 08 14:40:05 dist-test-slave-8n49 krb5kdc[12837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.81.61@KRBTEST.COM for kudu/127.20.81.60@KRBTEST.COM
I20260808 14:40:05.927088 13130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e: Generated new TSK 0
I20260808 14:40:05.927276 13130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:40:05.929623 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.921466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48256 (local address 127.20.81.60:42593)
0808 14:40:05.921497 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.921499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.921505 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:40:05.921525 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.921526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.921533 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.921570 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.921966 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.922666 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.924085 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.924361 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.924410 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.926750 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:05.926751 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:05.926752 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:05.926758 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:05.928389 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.928796 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.928797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.928798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.928865 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:05.929075 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:05.929076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:05.929076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:05.929215 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:05.929287 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.929453 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.929523 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:40:05.929623 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.921279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.81.60:42593 (local address 127.0.0.1:48256)
0808 14:40:05.921358 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:05.921368 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:05.921402 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:05.921667 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:05.921668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:05.921851 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:05.921893 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.921894 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.923230 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.923231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.924004 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:05.924006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.924474 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.924475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:05.924535 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.925024 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:05.925029 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:05.926646 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:05.928489 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.928489 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.928490 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.928730 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.928948 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:05.928948 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:05.928949 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:05.929019 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:05.929292 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:05.929293 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:05.929334 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:40:05.929428 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:40:05.929523 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 14:40:05.931618 13007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2: Bootstrap starting.
I20260808 14:40:05.932428 13007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:05.932797 13007 log.cc:824] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:05.933611 13007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2: No bootstrap required, opened a new log
I20260808 14:40:05.936221 13007 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } }
I20260808 14:40:05.936383 13007 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78178fce03ce4c7285f6ca0a006354d2, State: Initialized, Role: FOLLOWER
I20260808 14:40:05.936470 13007 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } }
I20260808 14:40:05.936846 13007 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:05.936923 12980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "78178fce03ce4c7285f6ca0a006354d2"
I20260808 14:40:05.937012 12980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:05.937968 12980 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4442f028e94491e9ae9c9fc212dfe4e in term 1.
I20260808 14:40:05.938187 12979 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [term 1 FOLLOWER]: Refusing update from remote peer a4442f028e94491e9ae9c9fc212dfe4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:05.939033 13128 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:05.942349 13157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
I20260808 14:40:05.942432 13157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:05.942477 13157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4442f028e94491e9ae9c9fc212dfe4e. Latest consensus state: current_term: 1 leader_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
I20260808 14:40:05.942520 13157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:05.942552 13157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
I20260808 14:40:05.942588 13157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:05.944012 13152 catalog_manager.cc:1259] Loaded cluster ID: a303e03e04ef49578c1dd7fd25fcaba5
I20260808 14:40:05.944106 13152 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2: loading cluster ID for follower catalog manager: success
I20260808 14:40:05.945278 13152 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2: acquiring CA information for follower catalog manager: success
I20260808 14:40:05.945662 13152 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 78178fce03ce4c7285f6ca0a006354d2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 14:40:05.958122 12930 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:05.956451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55222 (local address 127.20.81.62:39075)
0808 14:40:05.956499 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.956501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.957379 (+ 878us) server_negotiation.cc:407] Connection header received
0808 14:40:05.957496 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.957498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.957510 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.957543 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.958027 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55222: BlockingRecv error: recv got EOF from 127.0.0.1:55222 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 14:40:05.959165 13011 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:05.956912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43768 (local address 127.20.81.61:40355)
0808 14:40:05.956960 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.956961 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.958618 (+ 1657us) server_negotiation.cc:407] Connection header received
0808 14:40:05.958728 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.958729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.958739 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.958769 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.959076 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43768: BlockingRecv error: recv got EOF from 127.0.0.1:43768 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 14:40:05.960029 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:05.957076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48264 (local address 127.20.81.60:42593)
0808 14:40:05.957129 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.957131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.959518 (+ 2387us) server_negotiation.cc:407] Connection header received
0808 14:40:05.959615 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.959617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.959628 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.959658 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.959965 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48264: BlockingRecv error: recv got EOF from 127.0.0.1:48264 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:05.965198 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.961369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43772 (local address 127.20.81.61:40355)
0808 14:40:05.961401 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.961403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.961565 (+ 162us) server_negotiation.cc:407] Connection header received
0808 14:40:05.961669 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.961670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.961709 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.961756 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:05.961945 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.962742 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.963918 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.964227 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.964267 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.964486 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:05.964646 (+ 160us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:05.964700 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.965092 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.965126 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 14:40:05.968410 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:05.967599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48266 (local address 127.20.81.60:42593)
0808 14:40:05.967636 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.967638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.967879 (+ 241us) server_negotiation.cc:407] Connection header received
0808 14:40:05.967989 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.967990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.968009 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.968037 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.968360 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48266: BlockingRecv error: recv got EOF from 127.0.0.1:48266 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:05.979823 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.970710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43788 (local address 127.20.81.61:40355)
0808 14:40:05.970744 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.970746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.976792 (+ 6046us) server_negotiation.cc:407] Connection header received
0808 14:40:05.976899 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.976901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.976911 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.976941 (+ 30us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:05.977139 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.977884 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.979008 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.979314 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.979355 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.979550 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:05.979584 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:05.979612 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.979717 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.979743 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 14:40:05.983415 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:05.982547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48272 (local address 127.20.81.60:42593)
0808 14:40:05.982584 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.982586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.982816 (+ 230us) server_negotiation.cc:407] Connection header received
0808 14:40:05.982969 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.982971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.982982 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.983011 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.983363 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48272: BlockingRecv error: recv got EOF from 127.0.0.1:48272 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:05.989928 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.986676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43798 (local address 127.20.81.61:40355)
0808 14:40:05.986713 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.986715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.986930 (+ 215us) server_negotiation.cc:407] Connection header received
0808 14:40:05.987024 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.987025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.987035 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.987062 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:05.987262 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.987975 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.989104 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.989405 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:05.989464 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:05.989659 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:05.989693 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:05.989721 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:05.989836 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 14:40:05.989854 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 14:40:05.993119 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:05.992285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48278 (local address 127.20.81.60:42593)
0808 14:40:05.992322 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.992324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.992592 (+ 268us) server_negotiation.cc:407] Connection header received
0808 14:40:05.992691 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.992692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.992703 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.992732 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:05.993059 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48278: BlockingRecv error: recv got EOF from 127.0.0.1:48278 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:40:06.005080 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:05.998351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43810 (local address 127.20.81.61:40355)
0808 14:40:05.998389 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:05.998391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:05.998615 (+ 224us) server_negotiation.cc:407] Connection header received
0808 14:40:05.998715 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:05.998716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:05.998727 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:05.998755 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:05.998920 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:05.999694 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.000838 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.001181 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.001222 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:06.001421 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:06.001454 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:06.001481 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:06.001584 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 14:40:06.001603 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 14:40:06.008587 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:06.007729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48286 (local address 127.20.81.60:42593)
0808 14:40:06.007771 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.007773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.007997 (+ 224us) server_negotiation.cc:407] Connection header received
0808 14:40:06.008095 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.008096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.008107 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.008152 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:06.008495 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48286: BlockingRecv error: recv got EOF from 127.0.0.1:48286 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:40:06.021155 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:06.017885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43814 (local address 127.20.81.61:40355)
0808 14:40:06.017924 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.017926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.018166 (+ 240us) server_negotiation.cc:407] Connection header received
0808 14:40:06.018266 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.018267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.018277 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.018306 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:06.018474 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.019229 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.020333 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.020651 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.020693 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:06.020890 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:06.020924 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:06.020950 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:06.021046 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:40:06.021064 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:40:06.024806 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:06.023946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48300 (local address 127.20.81.60:42593)
0808 14:40:06.023988 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.023990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.024258 (+ 268us) server_negotiation.cc:407] Connection header received
0808 14:40:06.024351 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.024352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.024363 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.024391 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:06.024752 (+ 361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48300: BlockingRecv error: recv got EOF from 127.0.0.1:48300 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:06.045773 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:06.042350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43826 (local address 127.20.81.61:40355)
0808 14:40:06.042402 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.042405 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.042700 (+ 295us) server_negotiation.cc:407] Connection header received
0808 14:40:06.042814 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.042815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.042827 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.042858 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:06.043051 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.043784 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.044937 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.045230 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.045278 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:06.045490 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:06.045526 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:06.045556 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:06.045670 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 14:40:06.045690 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 14:40:06.049482 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:06.048598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48304 (local address 127.20.81.60:42593)
0808 14:40:06.048643 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.048645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.048880 (+ 235us) server_negotiation.cc:407] Connection header received
0808 14:40:06.048984 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.048985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.048996 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.049026 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:06.049420 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48304: BlockingRecv error: recv got EOF from 127.0.0.1:48304 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:40:06.086344 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:06.083152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43838 (local address 127.20.81.61:40355)
0808 14:40:06.083198 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.083200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.083327 (+ 127us) server_negotiation.cc:407] Connection header received
0808 14:40:06.083392 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.083393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.083405 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.083462 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:06.083633 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.084393 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.085549 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.085847 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.085915 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:06.086085 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:06.086123 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:06.086172 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:06.086237 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:40:06.086256 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 14:40:06.089258 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:06.088411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48316 (local address 127.20.81.60:42593)
0808 14:40:06.088462 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.088464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.088711 (+ 247us) server_negotiation.cc:407] Connection header received
0808 14:40:06.088773 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.088774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.088790 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.088845 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:06.089204 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48316: BlockingRecv error: recv got EOF from 127.0.0.1:48316 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:40:06.156800 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:06.154465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43854 (local address 127.20.81.61:40355)
0808 14:40:06.154533 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.154536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.154630 (+ 94us) server_negotiation.cc:407] Connection header received
0808 14:40:06.154698 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.154699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.154709 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.154752 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:06.154876 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.155359 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.156100 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.156279 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.156330 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:06.156515 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:06.156541 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:06.156625 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:06.156672 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 14:40:06.156692 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260808 14:40:06.159228 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:06.158625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48322 (local address 127.20.81.60:42593)
0808 14:40:06.158673 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.158675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.158722 (+ 47us) server_negotiation.cc:407] Connection header received
0808 14:40:06.158778 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.158778 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.158788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.158833 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:06.159167 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48322: BlockingRecv error: recv got EOF from 127.0.0.1:48322 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:40:06.290974 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:06.288745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43862 (local address 127.20.81.61:40355)
0808 14:40:06.288824 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.288827 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.288907 (+ 80us) server_negotiation.cc:407] Connection header received
0808 14:40:06.288953 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.288954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.288964 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.289028 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:06.289154 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.289640 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.290352 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.290528 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.290578 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:06.290755 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:06.290782 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:06.290820 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:06.290897 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:40:06.290913 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 14:40:06.293376 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:06.292754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48338 (local address 127.20.81.60:42593)
0808 14:40:06.292826 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.292828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.292854 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:40:06.292931 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.292933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.292945 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.292991 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:06.293317 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48338: BlockingRecv error: recv got EOF from 127.0.0.1:48338 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:40:06.318841 13128 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4442f028e94491e9ae9c9fc212dfe4e" member_type: VOTER last_known_addr { host: "127.20.81.62" port: 39075 } } peers { permanent_uuid: "78178fce03ce4c7285f6ca0a006354d2" member_type: VOTER last_known_addr { host: "127.20.81.61" port: 40355 } } peers { permanent_uuid: "253df1be278c4208b8ab7ba1cab0503e" member_type: VOTER last_known_addr { host: "127.20.81.60" port: 42593 } } }
I20260808 14:40:06.319052 13128 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4442f028e94491e9ae9c9fc212dfe4e [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:06.552932 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:06.550650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53856 (local address 127.20.81.61:40355)
0808 14:40:06.550727 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.550729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.550742 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:40:06.550810 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.550811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.550821 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.550871 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:06.551020 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.551505 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.552233 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:06.552428 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:06.552478 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:06.552709 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:06.552744 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:06.552799 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:06.552849 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 14:40:06.552868 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 14:40:06.555331 13094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:06.554791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34922 (local address 127.20.81.60:42593)
0808 14:40:06.554857 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:06.554859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:06.554866 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:06.554892 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:06.554893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:06.554902 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:06.554953 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:06.555272 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34922: BlockingRecv error: recv got EOF from 127.0.0.1:34922 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:40:06.873421 13107 catalog_manager.cc:1259] Loaded cluster ID: a303e03e04ef49578c1dd7fd25fcaba5
I20260808 14:40:06.873497 13107 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e: loading cluster ID for follower catalog manager: success
I20260808 14:40:06.874358 13107 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e: acquiring CA information for follower catalog manager: success
I20260808 14:40:06.874696 13107 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 253df1be278c4208b8ab7ba1cab0503e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:40:07.071050 13283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:07.068594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53872 (local address 127.20.81.61:40355)
0808 14:40:07.068709 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:07.068711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:07.068761 (+ 50us) server_negotiation.cc:407] Connection header received
0808 14:40:07.068824 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:07.068825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:07.068835 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:07.068895 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:07.069038 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.069534 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.070396 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.070594 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.070648 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:07.070801 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:07.070830 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:07.070865 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:07.070908 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 14:40:07.070925 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":61,"threads_started":1}
I20260808 14:40:07.075246 13289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:07.072961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34934 (local address 127.20.81.60:42593)
0808 14:40:07.073096 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:07.073098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:07.073106 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:07.073183 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:07.073183 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:07.073234 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:07.073305 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:07.073392 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.073872 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.074534 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.074729 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.074779 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:07.074907 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:07.075017 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:07.075075 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:07.075109 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 14:40:07.075127 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":100,"threads_started":1}
I20260808 14:40:07.079758 13289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:07.077079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34950 (local address 127.20.81.60:42593)
0808 14:40:07.077127 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:07.077129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:07.077253 (+ 124us) server_negotiation.cc:407] Connection header received
0808 14:40:07.077364 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:07.077365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:07.077375 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:07.077427 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:07.077565 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.078009 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.079002 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.079306 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.079379 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:07.079495 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:07.079526 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:07.079575 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:07.079647 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 14:40:07.079670 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:40:07.079998 13283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:07.077030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53888 (local address 127.20.81.61:40355)
0808 14:40:07.077095 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:07.077097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:07.077247 (+ 150us) server_negotiation.cc:407] Connection header received
0808 14:40:07.077313 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:07.077314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:07.077325 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:07.077370 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:07.077576 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.078290 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.079166 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.079460 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.079527 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:07.079713 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:07.079751 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:07.079784 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:07.079901 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:40:07.079929 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:40:07.080427 13296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:07.076988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57706 (local address 127.20.81.62:39075)
0808 14:40:07.077149 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:07.077151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:07.077161 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:40:07.077210 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:07.077211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:07.077267 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:07.077345 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:07.077527 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.078305 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.079319 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:07.079675 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:07.079736 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:07.079995 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:07.080118 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:07.080180 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:07.080286 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 14:40:07.080319 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":62,"threads_started":1}
I20260808 14:40:07.085371 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 12851
I20260808 14:40:07.093348 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 12934
I20260808 14:40:07.099985 20804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx904RQ/build/release/bin/kudu with pid 13014
2026-08-08T14:40:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2891 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5778 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (271689 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST